00000001:02000400:2.0F:1787829660.397864:0:2954:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg151-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1787829668.314558:0:3156:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg151-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1787829669.266483:0:3199:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1403 MB/s 00000001:01000000:2.0:1787829669.516580:0:3199:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1659 MB/s 00000001:01000000:2.0:1787829669.766153:0:3199:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10547 MB/s 00000020:02000000:0.0:1787829670.044668:0:3247:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_64_gb96373c 00000400:02000000:3.0F:1787829670.396542:0:3262:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.151@tcp [8/256/0/180] 00008000:02000000:3.0:1787829672.745744:0:3411:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0F:1787829723.314560:0:5215:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg151-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787829734.948633:0:5786:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787829734.948640:0:5786:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787829734.948837:0:5786:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000cfd82227 00000080:02000400:0.0:1787829734.948852:0:5786:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1787829734.958491:0:5786:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1787829734.958512:0:5786:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787829734.958577:0:5786:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000ae45ee10) 00000020:00000080:0.0:1787829734.958600:0:5786:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787829735.003514:0:5786:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787829735.016764:0:5786:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787829735.064147:0:5786:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787829735.064198:0:5786:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787829735.064222:0:5786:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787829735.064488:0:5786:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787829735.064659:0:5786:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1787829735.065251:0:5786:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787829735.065262:0:5786:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787829735.065387:0:5786:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc03b4d103c0d74f2 00000020:01000004:1.0:1787829735.065399:0:5786:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1787829735.065405:0:5786:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787829735.065411:0:5786:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000cfd82227 from MGS 00000020:01000004:1.0:1787829735.065505:0:5786:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787829735.065651:0:5786:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000dc184e9f) 00000020:00000080:1.0:1787829735.065669:0:5786:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787829735.065749:0:5786:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000cfd82227 from MGS, refs=2 00080000:01000000:1.0:1787829735.065756:0:5786:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787829735.065763:0:5786:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc03b4d103c0d7500 00000100:00100000:1.0:1787829735.065895:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787829735.066110:0:5786:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787829735.066118:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787829735.066786:0:5786:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787829735.066794:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787829735.070007:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787829735.070266:0:5786:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787829735.070273:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787829735.071928:0:5786:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787829735.071942:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787829735.072866:0:5786:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787829735.072876:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787829735.074141:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829735.074147:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829735.074149:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829735.074450:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829735.074452:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829735.074454:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829735.075298:0:5786:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787829735.077182:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787829735.327561:0:5786:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2766 MB/s 00000001:01000000:3.0:1787829735.577348:0:5786:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 1743 MB/s 00000001:01000000:3.0:1787829735.830392:0:5786:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 679 MB/s 00000001:01000000:2.0:1787829736.080509:0:5786:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 819 MB/s 00080000:10000000:2.0:1787829736.086681:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1787829736.097565:0:5786:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787829736.097582:0:5786:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787829736.097585:0:5786:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1787829736.098652:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787829736.098713:0:5786:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787829736.098746:0:5786:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1787829736.098919:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787829736.098945:0:5786:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787829736.099475:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787829736.099637:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787829736.099655:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787829736.101525:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787829736.101537:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787829736.103493:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787829736.103509:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00010000:00010000:0.0:1787829736.103682:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787829736.104648:0:5786:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787829736.104670:0:5786:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.151@tcp' 00000020:01000004:0.0:1787829736.104672:0:5786:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787829736.104721:0:5786:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.151@tcp (typ=mgc) 00000020:00000080:0.0:1787829736.104733:0:5786:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.151@tcp (00000000e87cb2ea) 00000020:00000080:0.0:1787829736.104750:0:5786:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787829736.104828:0:5786:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000009f3e9b5@MGC192.168.201.151@tcp: add connection 192.168.201.151@tcp at head 00010000:00010000:0.0:1787829736.105004:0:5786:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.151@tcp-0 is initialized 00000040:01000000:0.0:1787829736.105011:0:5786:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.151@tcp ctxt 1 is initialized 10000000:01000000:0.0:1787829736.105236:0:5802:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787829736.105259:0:5786:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.151@tcp (uuid 6ff77d2d-a894-4919-b9b2-0fa36523bae1) 00000020:00000080:0.0:1787829736.105273:0:5786:0:(genops.c:1385:class_connect()) connect: client 6ff77d2d-a894-4919-b9b2-0fa36523bae1, cookie 0xc03b4d103c0d750e 00000100:00080000:1.0:1787829736.105434:0:5801:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00080000:0.0:1787829736.107456:0:5786:0:(import.c:510:import_select_connection()) MGC192.168.201.151@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787829736.107474:0:5786:0:(import.c:624:import_select_connection()) MGC192.168.201.151@tcp: import 0000000009f3e9b5 using connection 192.168.201.151@tcp/0@lo 00000100:00100000:0.0:1787829736.107512:0:5786:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b31a3113 x1874675284050048/t0(0) o250->MGC192.168.201.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787829736.107599:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b31a3113 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3277:1874675284050048:0@lo:250: 00000100:00100000:0.0:1787829736.107676:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829736.107746:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284050048 00000100:00100000:0.0:1787829736.107753:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284050048 00000100:00100000:0.0:1787829736.107781:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787829736.107787:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9c1d084 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3277:x1874675284050048:12345-0@lo:250: 00010000:00080000:0.0:1787829736.107809:0:5798:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 6ff77d2d-a894-4919-b9b2-0fa36523bae1@0@lo t0 exp 0000000000000000 cur 116 last 0 00000020:00000080:0.0:1787829736.107840:0:5798:0:(genops.c:1385:class_connect()) connect: client 6ff77d2d-a894-4919-b9b2-0fa36523bae1, cookie 0xc03b4d103c0d7515 00000100:00080000:0.0:1787829736.107990:0:5798:0:(import.c:65:import_set_state_nolock()) 000000000bcee744 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787829736.108060:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9c1d084 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+5:3277:x1874675284050048:12345-0@lo:250: Request processed in 272us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829736.108068:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787829736.108109:0:3277:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.151@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787829736.108118:0:3277:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.151@tcp: connect to target with instance 0 00000100:00080000:0.0:1787829736.108124:0:3277:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787829736.108129:0:3277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787829736.108132:0:3277:0:(import.c:65:import_set_state_nolock()) 0000000009f3e9b5 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787829736.108134:0:3277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787829736.108138:0:3277:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787829736.108141:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b31a3113 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3277:1874675284050048:0@lo:250: 00000100:00080000:0.0:1787829736.108161:0:5786:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6ff77d2d-a894-4919-b9b2-0fa36523bae1->MGS 00000020:01000004:0.0:1787829736.108185:0:5786:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787829736.108190:0:5786:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787829736.108202:0:5786:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000506416f1) 00000020:00000080:0.0:1787829736.108212:0:5786:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787829736.130054:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787829736.130312:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787829736.130328:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787829736.131358:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787829736.131366:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787829736.134953:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787829736.134967:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787829736.136883:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787829736.138422:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787829736.138430:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787829736.148396:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787829736.148418:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787829736.210559:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787829736.210769:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787829736.210776:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787829736.212346:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787829736.212356:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787829736.213663:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787829736.213847:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787829736.213860:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787829736.214739:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787829736.214747:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787829736.215476:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787829736.215676:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787829736.215683:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787829736.216470:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787829736.216478:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787829736.217164:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787829736.217403:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787829736.217408:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787829736.217798:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787829736.217803:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787829736.258879:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787829736.259140:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787829736.259147:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787829736.263839:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787829736.263857:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787829736.265519:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787829736.265533:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787829736.269717:0:5786:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787829736.269752:0:5786:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787829736.269759:0:5786:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787829736.269910:0:5786:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.151@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787829736.269944:0:5786:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.151@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1787829736.269948:0:5786:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787829736.269950:0:5786:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787829736.269951:0:5786:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787829736.269952:0:5786:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787829736.269954:0:5786:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787829736.269955:0:5786:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787829736.269957:0:5786:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787829736.269958:0:5786:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787829736.269959:0:5786:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787829736.269960:0:5786:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787829736.269962:0:5786:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787829736.269963:0:5786:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787829736.269965:0:5786:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1787829736.269968:0:5786:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787829736.269969:0:5786:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787829736.269970:0:5786:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787829736.269971:0:5786:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787829736.269984:0:5786:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787829736.269985:0:5786:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787829736.269986:0:5786:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787829736.269987:0:5786:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787829736.269988:0:5786:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787829736.269989:0:5786:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787829736.269990:0:5786:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787829736.269991:0:5786:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787829736.270056:0:5786:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787829736.270076:0:5786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ca5a5bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284050176:0@lo:253: 00000100:00100000:1.0:1787829736.270170:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829736.270300:0:5786:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f10c69ce going to sleep for 11 seconds 00000100:00100000:0.0:1787829736.270566:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284050176 00000100:00100000:0.0:1787829736.270574:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284050176 00000100:00100000:0.0:1787829736.270650:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787829736.270659:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005bed6f3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+5:5786:x1874675284050176:12345-0@lo:253: 20000000:01000000:0.0:1787829736.270706:0:5800:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787829736.270708:0:5800:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1787829736.271208:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787829736.271335:0:5800:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1787829736.271626:0:5800:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787829736.272627:0:5821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1787829736.272842:0:5800:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787829736.272846:0:5800:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1787829736.272851:0:5800:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1787829736.272855:0:5800:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1787829736.272867:0:5800:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1787829736.273131:0:5800:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787829736.273656:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1787829736.273670:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787829736.273720:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1787829736.273766:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1787829736.273798:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1787829736.273891:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1787829736.273950:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1787829736.277154:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1787829736.277185:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1787829736.277337:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1787829736.277347:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1787829736.277381:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1787829736.277460:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1787829736.277545:0:5800:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787829736.277553:0:5800:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1787829736.277571:0:5800:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787829736.277804:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1787829736.277814:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787829736.277844:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1787829736.277873:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1787829736.277926:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1787829736.277937:0:5800:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1787829736.279096:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1787829736.279114:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787829736.279179:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1787829736.279208:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1787829736.279345:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1787829736.279359:0:5800:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1787829736.279465:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1787829736.279473:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1787829736.279502:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1787829736.279531:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1787829736.279677:0:5800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1787829736.279717:0:5800:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787829736.279724:0:5800:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1787829736.283292:0:5822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1787829736.283910:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1787829736.283937:0:5800:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.151@tcp for mdt 20000000:01000000:3.0:1787829736.283940:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.151@tcp (null) (null) (null) 00000040:00080000:3.0:1787829736.284418:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1787829736.284430:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787829736.284465:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1787829736.284472:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.151@tcp (null) (null) 00000040:00080000:3.0:1787829736.284522:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1787829736.284533:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787829736.284567:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1787829736.284609:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1787829736.284682:0:5800:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787829736.284685:0:5800:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787829736.284689:0:5800:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787829736.284712:0:5800:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787829736.284715:0:5800:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787829736.284741:0:5800:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787829736.284743:0:5800:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787829736.285370:0:5823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1787829736.285616:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1787829736.285653:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1787829736.285730:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1787829736.285744:0:5800:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787829736.285746:0:5800:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787829736.286587:0:5824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1787829736.286847:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1787829736.286889:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1787829736.286924:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1787829736.286938:0:5800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787829736.286940:0:5800:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1787829736.286944:0:5800:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787829736.286947:0:5800:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787829736.286951:0:5800:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787829736.286956:0:5800:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787829736.288365:0:5825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1787829736.288487:0:5800:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1787829736.299476:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1787829736.299532:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1787829736.299608:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1787829736.299632:0:5800:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787829736.299654:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000162bc6d5/0xc03b4d103c0d7523 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829736.299671:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000162bc6d5/0xc03b4d103c0d7523 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829736.299697:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000162bc6d5/0xc03b4d103c0d7523 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829736.299704:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000162bc6d5/0xc03b4d103c0d7523 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829736.299711:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000162bc6d5/0xc03b4d103c0d7523 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829736.299718:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000162bc6d5/0xc03b4d103c0d7523 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829736.299724:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000162bc6d5 already unused, calling callback (000000008d409c71) 00010000:00010000:3.0:1787829736.299728:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000162bc6d5/0xc03b4d103c0d7523 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829736.299735:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000162bc6d5/0xc03b4d103c0d7523 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829736.299747:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000162bc6d5/0xc03b4d103c0d7523 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829736.299754:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000162bc6d5/0xc03b4d103c0d7523 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829736.299760:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000162bc6d5/0xc03b4d103c0d7523 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787829736.299780:0:5800:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787829736.655891:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005bed6f3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+5:5786:x1874675284050176:12345-0@lo:253: Request processed in 385221us (385709us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829736.655912:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787829736.656084:0:5786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ca5a5bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284050176:0@lo:253: 10000000:01000000:1.0:1787829736.656105:0:5786:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787829736.656109:0:5786:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787829736.656111:0:5786:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787829736.656113:0:5786:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787829736.656114:0:5786:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1787829736.656115:0:5786:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787829736.656117:0:5786:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787829736.656118:0:5786:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787829736.656120:0:5786:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787829736.656121:0:5786:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787829736.656123:0:5786:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787829736.656124:0:5786:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787829736.656150:0:5786:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000cfd82227 from lustre-MDT0000 10000000:01000000:1.0:1787829736.656185:0:5786:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787829736.656203:0:5786:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787829736.656209:0:5786:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9e9b4f8419b8 10000000:01000000:1.0:1787829736.656217:0:5786:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787829736.656226:0:5786:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e9b4f8419b8 from 1 10000000:01000000:1.0:1787829736.656230:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787829736.656282:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: 00000000f09cf9cd/0xc03b4d103c0d752a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829736.656294:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: 00000000f09cf9cd/0xc03b4d103c0d752a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829736.656305:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: 00000000f09cf9cd/0xc03b4d103c0d752a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829736.656326:0:5786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ca5a5bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284050304:0@lo:101: 00000100:00100000:1.0:1787829736.656375:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829736.656533:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284050304 00000100:00100000:3.0:1787829736.656548:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284050304 00000100:00100000:3.0:1787829736.656619:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787829736.656627:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d40639d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+5:5786:x1874675284050304:12345-0@lo:101: 00010000:00010000:3.0:1787829736.656646:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829736.656665:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000162bc6d5/0xc03b4d103c0d7531 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d752a expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829736.656691:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000162bc6d5/0xc03b4d103c0d7531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d752a expref: 6 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829736.656702:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000162bc6d5/0xc03b4d103c0d7531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d752a expref: 6 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829736.656711:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000162bc6d5, rc 0) 00000100:00100000:1.0:1787829736.656712:0:5786:0:(client.c:2715:ptlrpc_set_wait()) set 00000000892eccd9 going to sleep for 11 seconds 00000100:00100000:3.0:1787829736.656810:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d40639d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+6:5786:x1874675284050304:12345-0@lo:101: Request processed in 183us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829736.656818:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787829736.657075:0:5786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ca5a5bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284050304:0@lo:101: 00010000:00010000:1.0:1787829736.657093:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: 00000000f09cf9cd/0xc03b4d103c0d752a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7531 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829736.657102:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: 00000000f09cf9cd/0xc03b4d103c0d752a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d7531 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829736.657176:0:5786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ca5a5bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284050432:0@lo:501: 00000100:00100000:1.0:1787829736.657211:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829736.657936:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284050432 00000100:00100000:0.0:1787829736.657948:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284050432 00000100:00100000:0.0:1787829736.658051:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787829736.658061:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000acf2130f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+6:5786:x1874675284050432:12345-0@lo:501: 00000100:00100000:0.0:1787829736.660059:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000acf2130f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+6:5786:x1874675284050432:12345-0@lo:501: Request processed in 1987us (2835us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787829736.660079:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787829736.661983:0:5786:0:(client.c:2715:ptlrpc_set_wait()) set 00000000892eccd9 going to sleep for 11 seconds 00000100:00100000:1.0:1787829736.662048:0:5786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ca5a5bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284050432:0@lo:501: 10000000:01000000:1.0:1787829736.662094:0:5786:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787829736.662112:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: 00000000f09cf9cd/0xc03b4d103c0d752a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7531 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829736.662122:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: 00000000f09cf9cd/0xc03b4d103c0d752a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7531 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787829736.662131:0:5786:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e9b51a3b000 10000000:01000000:1.0:1787829736.662137:0:5786:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787829736.662142:0:5786:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e9b51a3b000 10000000:01000000:1.0:1787829736.662145:0:5786:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787829736.662148:0:5786:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9e9b51a3b000 from 1 10000000:01000000:1.0:1787829736.662150:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787829736.662179:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: 00000000d58c3b3c/0xc03b4d103c0d7538 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829736.662186:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: 00000000d58c3b3c/0xc03b4d103c0d7538 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829736.662211:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: 00000000d58c3b3c/0xc03b4d103c0d7538 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829736.662242:0:5786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ca5a5bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284050560:0@lo:101: 00000100:00100000:1.0:1787829736.662301:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829736.662331:0:5786:0:(client.c:2715:ptlrpc_set_wait()) set 00000000892eccd9 going to sleep for 11 seconds 00000100:00100000:0.0:1787829736.662787:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284050560 00000100:00100000:0.0:1787829736.662810:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284050560 00000100:00100000:0.0:1787829736.662889:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787829736.662900:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001fae0fd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+6:5786:x1874675284050560:12345-0@lo:101: 00010000:00010000:0.0:1787829736.662922:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829736.662946:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000921b864b/0xc03b4d103c0d753f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d7538 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829736.662987:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000921b864b/0xc03b4d103c0d753f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d7538 expref: 7 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829736.662999:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000921b864b/0xc03b4d103c0d753f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7538 expref: 7 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829736.663008:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000921b864b, rc 0) 00000100:00100000:0.0:1787829736.663121:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001fae0fd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+7:5786:x1874675284050560:12345-0@lo:101: Request processed in 223us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829736.663142:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787829736.665312:0:5786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ca5a5bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284050560:0@lo:101: 00010000:00010000:1.0:1787829736.665338:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: 00000000d58c3b3c/0xc03b4d103c0d7538 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d753f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829736.665359:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: 00000000d58c3b3c/0xc03b4d103c0d7538 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d753f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787829736.665378:0:5786:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787829736.665395:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: 00000000d58c3b3c/0xc03b4d103c0d7538 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d753f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829736.665402:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: 00000000d58c3b3c/0xc03b4d103c0d7538 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d753f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787829736.665409:0:5786:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787829736.665417:0:5786:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787829736.665422:0:5786:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e9b51a3b000 10000000:01000000:1.0:1787829736.665424:0:5786:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787829736.665428:0:5786:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787829736.665430:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787829736.665456:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: 000000000145a447/0xc03b4d103c0d7546 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829736.665475:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: 000000000145a447/0xc03b4d103c0d7546 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829736.665482:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: 000000000145a447/0xc03b4d103c0d7546 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829736.665497:0:5786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ca5a5bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284050688:0@lo:101: 00000100:00100000:1.0:1787829736.665551:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829736.665596:0:5786:0:(client.c:2715:ptlrpc_set_wait()) set 00000000892eccd9 going to sleep for 11 seconds 00000100:00100000:0.0:1787829736.665763:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284050688 00000100:00100000:0.0:1787829736.665770:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284050688 00000100:00100000:0.0:1787829736.665818:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787829736.665825:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4f9d82e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+7:5786:x1874675284050688:12345-0@lo:101: 00010000:00010000:0.0:1787829736.665839:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829736.665851:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000032bea42e/0xc03b4d103c0d754d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d7546 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829736.665868:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000032bea42e/0xc03b4d103c0d754d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d7546 expref: 8 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829736.665876:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000032bea42e/0xc03b4d103c0d754d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7546 expref: 8 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829736.665884:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000032bea42e, rc 0) 00000100:00100000:0.0:1787829736.665931:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4f9d82e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+8:5786:x1874675284050688:12345-0@lo:101: Request processed in 104us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829736.665937:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787829736.669207:0:5786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ca5a5bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284050688:0@lo:101: 00010000:00010000:1.0:1787829736.669240:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: 000000000145a447/0xc03b4d103c0d7546 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d754d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829736.669252:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: 000000000145a447/0xc03b4d103c0d7546 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d754d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829736.669332:0:5786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ca5a5bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284050816:0@lo:501: 00000100:00100000:1.0:1787829736.669392:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829736.669454:0:5786:0:(client.c:2715:ptlrpc_set_wait()) set 00000000892eccd9 going to sleep for 11 seconds 00000100:00100000:2.0:1787829736.669517:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284050816 00000100:00100000:2.0:1787829736.669533:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284050816 00000100:00100000:2.0:1787829736.669659:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787829736.669670:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009960c9e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+8:5786:x1874675284050816:12345-0@lo:501: 00000100:00100000:1.0:1787829736.670347:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009960c9e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+9:5786:x1874675284050816:12345-0@lo:501: Request processed in 675us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829736.670370:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787829736.670411:0:5786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ca5a5bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284050816:0@lo:501: 00000100:00100000:2.0:1787829736.670492:0:5786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015d4185c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284050944:0@lo:503: 00000100:00100000:2.0:1787829736.670682:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829736.670725:0:5786:0:(client.c:2715:ptlrpc_set_wait()) set 0000000018c5b751 going to sleep for 11 seconds 00000100:00100000:0.0:1787829736.670879:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284050944 00000100:00100000:0.0:1787829736.670885:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284050944 00000100:00100000:0.0:1787829736.670932:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787829736.670940:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e854aa8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+9:5786:x1874675284050944:12345-0@lo:503: 00000100:00100000:0.0:1787829736.671312:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e854aa8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+9:5786:x1874675284050944:12345-0@lo:503: Request processed in 373us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829736.671321:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787829736.671435:0:5786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015d4185c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284050944:0@lo:503: 00000100:00100000:2.0:1787829736.672155:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015d4185c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5828:1874675284051072:0@lo:502: 00000100:00100000:2.0:1787829736.672356:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829736.672398:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb881233 going to sleep for 11 seconds 00000100:00100000:1.0:1787829736.672453:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284051072 00000100:00100000:1.0:1787829736.672460:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284051072 00000100:00100000:1.0:1787829736.672507:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787829736.672515:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009afa0a7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+9:5828:x1874675284051072:12345-0@lo:502: 00000100:00100000:1.0:1787829736.672772:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009afa0a7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+9:5828:x1874675284051072:12345-0@lo:502: Request processed in 257us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829736.672787:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787829736.673075:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015d4185c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5828:1874675284051072:0@lo:502: 00000020:01000000:2.0:1787829736.673110:0:5828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787829736.673125:0:5828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787829736.673128:0:5828:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787829736.673134:0:5828:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787829736.673138:0:5828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787829736.673167:0:5828:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000c6a29e83) 00000020:00000080:2.0:1787829736.673207:0:5828:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787829736.673215:0:5828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787829736.673352:0:5828:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787829736.673361:0:5828:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc03b4d103c0d755b 00000020:00000080:2.0:1787829736.673769:0:5828:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787829736.673781:0:5828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787829736.673788:0:5828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787829736.673791:0:5828:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787829736.673794:0:5828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787829736.673801:0:5828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787829736.673803:0:5828:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787829736.674223:0:5828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787829736.674255:0:5828:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000004746492b) 00000020:00000080:3.0:1787829736.674278:0:5828:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787829736.674285:0:5828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787829736.674287:0:5828:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787829736.674289:0:5828:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787829736.674295:0:5828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787829736.674402:0:5828:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000cfd82227 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787829736.674415:0:5828:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000009fdc82dc) 00000020:00000080:3.0:1787829736.674423:0:5828:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787829736.674607:0:5828:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787829736.674615:0:5828:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc03b4d103c0d7570 00000020:00000080:3.0:1787829736.674739:0:5828:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787829736.674745:0:5828:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787829736.674750:0:5828:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc03b4d103c0d7577 00080000:01000000:3.0:1787829736.674764:0:5828:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787829736.674768:0:5828:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc03b4d103c0d757e 00080000:10000000:3.0:1787829736.675292:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1787829736.678723:0:5828:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1787829736.684885:0:5828:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787829736.796148:0:5828:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787829736.796609:0:5828:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787829736.799723:0:5828:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787829736.800272:0:5828:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787829736.846152:0:5828:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000e3c84dd4) 00000020:00000080:3.0:1787829736.846176:0:5828:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787829736.846255:0:5828:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787829736.846262:0:5828:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc03b4d103c0d758c 00000020:00000080:1.0:1787829736.854200:0:5828:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1787829736.862127:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787829736.935353:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787829736.987743:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787829737.035843:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787829737.075707:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787829737.114267:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00010000:00010000:2.0:1787829737.126045:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787829737.136395:0:5828:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc03b4d103c0d7593 00000020:00000080:3.0:1787829737.136874:0:5828:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787829737.136886:0:5828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787829737.136892:0:5828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787829737.136894:0:5828:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787829737.136897:0:5828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787829737.136901:0:5828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787829737.136902:0:5828:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787829737.136905:0:5828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787829737.136907:0:5828:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787829737.136910:0:5828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787829737.136912:0:5828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787829737.136913:0:5828:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787829737.136916:0:5828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787829737.136920:0:5828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787829737.136921:0:5828:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787829737.136925:0:5828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787829737.136971:0:5828:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1787829737.137053:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c8b9ac26 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5828:1874675284051200:0@lo:502: 00000100:00100000:3.0:1787829737.137138:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829737.137189:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 000000009b1f3ca0 going to sleep for 11 seconds 00000100:00100000:3.0:1787829737.137212:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284051200 00000100:00100000:3.0:1787829737.137218:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284051200 00000100:00100000:3.0:1787829737.137252:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787829737.137259:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6823737 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+9:5828:x1874675284051200:12345-0@lo:502: 00000100:00100000:3.0:1787829737.137616:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6823737 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+9:5828:x1874675284051200:12345-0@lo:502: Request processed in 357us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829737.137624:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787829737.137674:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c8b9ac26 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5828:1874675284051200:0@lo:502: 00000020:01000000:3.0:1787829737.137703:0:5828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787829737.137707:0:5828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787829737.137709:0:5828:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1787829737.137713:0:5828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1787829737.137822:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1787829737.137839:0:5786:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787829737.137854:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: 000000000145a447/0xc03b4d103c0d7546 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d754d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829737.137865:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: 000000000145a447/0xc03b4d103c0d7546 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d754d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787829737.137873:0:5786:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e9b51a3b000 from 1 10000000:01000000:3.0:1787829737.137877:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787829737.137901:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: 00000000b9e54895/0xc03b4d103c0d759a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829737.137908:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: 00000000b9e54895/0xc03b4d103c0d759a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829737.137928:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: 00000000b9e54895/0xc03b4d103c0d759a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829737.137941:0:5786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c8b9ac26 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284051328:0@lo:101: 00000100:00100000:3.0:1787829737.137979:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829737.137995:0:5786:0:(client.c:2715:ptlrpc_set_wait()) set 000000009b1f3ca0 going to sleep for 11 seconds 00000100:00100000:3.0:1787829737.138050:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284051328 00000100:00100000:3.0:1787829737.138054:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284051328 00000100:00100000:3.0:1787829737.138077:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787829737.138083:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b53ccfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+9:5786:x1874675284051328:12345-0@lo:101: 00010000:00010000:3.0:1787829737.138092:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829737.138104:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e1643fa7/0xc03b4d103c0d75a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d759a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829737.138123:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e1643fa7/0xc03b4d103c0d75a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d759a expref: 10 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829737.138133:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e1643fa7/0xc03b4d103c0d75a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d759a expref: 10 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829737.138140:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e1643fa7, rc 0) 00000100:00100000:3.0:1787829737.138168:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b53ccfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+10:5786:x1874675284051328:12345-0@lo:101: Request processed in 86us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829737.138174:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787829737.138203:0:5786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c8b9ac26 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284051328:0@lo:101: 00010000:00010000:3.0:1787829737.138214:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: 00000000b9e54895/0xc03b4d103c0d759a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d75a1 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829737.138231:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: 00000000b9e54895/0xc03b4d103c0d759a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d75a1 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829737.138906:0:5786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c8b9ac26 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284051456:0@lo:256: 00000100:00100000:3.0:1787829737.138946:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829737.139063:0:5786:0:(client.c:2715:ptlrpc_set_wait()) set 000000009b1f3ca0 going to sleep for 11 seconds 00000100:00100000:0.0:1787829737.139245:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284051456 00000100:00100000:0.0:1787829737.139251:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284051456 00000100:00100000:0.0:1787829737.139290:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787829737.139297:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051254463 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+10:5786:x1874675284051456:12345-0@lo:256: 20000000:01000000:0.0:1787829737.139313:0:5799:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787829737.139319:0:5799:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787829737.139399:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051254463 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+10:5786:x1874675284051456:12345-0@lo:256: Request processed in 103us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829737.139407:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787829737.139539:0:5786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c8b9ac26 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284051456:0@lo:256: 10000000:01000000:2.0:1787829737.140114:0:5786:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787829737.140138:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: 00000000b9e54895/0xc03b4d103c0d759a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d75a1 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829737.140162:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: 00000000b9e54895/0xc03b4d103c0d759a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d75a1 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787829737.140169:0:5786:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9b51a3b000 from 1 10000000:01000000:2.0:1787829737.140172:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787829737.140199:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: 000000001b95ddda/0xc03b4d103c0d75a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829737.140206:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: 000000001b95ddda/0xc03b4d103c0d75a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829737.140213:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: 000000001b95ddda/0xc03b4d103c0d75a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829737.140226:0:5786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015d4185c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284051584:0@lo:101: 00000100:00100000:2.0:1787829737.140260:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829737.140286:0:5786:0:(client.c:2715:ptlrpc_set_wait()) set 0000000089ccf255 going to sleep for 11 seconds 00000100:00100000:1.0:1787829737.140441:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284051584 00000100:00100000:1.0:1787829737.140446:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284051584 00000100:00100000:1.0:1787829737.140483:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787829737.140490:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c98b253 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+10:5786:x1874675284051584:12345-0@lo:101: 00010000:00010000:1.0:1787829737.140507:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829737.140520:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000defe73cc/0xc03b4d103c0d75af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d75a8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829737.140538:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000defe73cc/0xc03b4d103c0d75af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d75a8 expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829737.140547:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000defe73cc/0xc03b4d103c0d75af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d75a8 expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829737.140555:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000defe73cc, rc 0) 00000100:00100000:1.0:1787829737.140587:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c98b253 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+11:5786:x1874675284051584:12345-0@lo:101: Request processed in 97us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829737.140593:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787829737.140718:0:5786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015d4185c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284051584:0@lo:101: 00010000:00010000:2.0:1787829737.140729:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: 000000001b95ddda/0xc03b4d103c0d75a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d75af expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829737.140736:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: 000000001b95ddda/0xc03b4d103c0d75a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d75af expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829737.140785:0:5786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015d4185c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284051712:0@lo:501: 00000100:00100000:2.0:1787829737.140808:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829737.140835:0:5786:0:(client.c:2715:ptlrpc_set_wait()) set 0000000089ccf255 going to sleep for 11 seconds 00000100:00100000:1.0:1787829737.140941:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284051712 00000100:00100000:1.0:1787829737.140945:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284051712 00000100:00100000:1.0:1787829737.140980:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787829737.140986:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051a85adb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+11:5786:x1874675284051712:12345-0@lo:501: 00000100:00100000:1.0:1787829737.141650:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051a85adb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+11:5786:x1874675284051712:12345-0@lo:501: Request processed in 663us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829737.141658:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787829737.141781:0:5786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015d4185c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284051712:0@lo:501: 00000100:00100000:0.0:1787829737.141817:0:5786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b31a3113 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284051840:0@lo:503: 00000100:00100000:0.0:1787829737.141855:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829737.141882:0:5786:0:(client.c:2715:ptlrpc_set_wait()) set 00000000da59aebd going to sleep for 11 seconds 00000100:00100000:1.0:1787829737.141930:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284051840 00000100:00100000:1.0:1787829737.141934:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284051840 00000100:00100000:1.0:1787829737.141954:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787829737.141969:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020e30a4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+11:5786:x1874675284051840:12345-0@lo:503: 00000040:00080000:1.0:1787829737.142002:0:5799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787829737.142066:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020e30a4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+11:5786:x1874675284051840:12345-0@lo:503: Request processed in 106us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829737.142073:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787829737.142147:0:5786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b31a3113 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284051840:0@lo:503: 00000040:00080000:0.0:1787829737.143125:0:5832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1787829737.143266:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787829737.143284:0:5786:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787829737.143302:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: 000000001b95ddda/0xc03b4d103c0d75a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d75af expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829737.143311:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: 000000001b95ddda/0xc03b4d103c0d75a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d75af expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787829737.143350:0:5786:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787829737.143353:0:5786:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e9b51a3b000 10000000:01000000:2.0:1787829737.143356:0:5786:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e9b51a3b000 10000000:01000000:2.0:1787829737.143360:0:5786:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787829737.143365:0:5786:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e9b51a3b000 from 1 10000000:01000000:2.0:1787829737.143368:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787829737.143394:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: 00000000d3801099/0xc03b4d103c0d75b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829737.143401:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: 00000000d3801099/0xc03b4d103c0d75b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829737.143408:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: 00000000d3801099/0xc03b4d103c0d75b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829737.143423:0:5786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015d4185c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284051968:0@lo:101: 00000100:00100000:2.0:1787829737.143466:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829737.143496:0:5786:0:(client.c:2715:ptlrpc_set_wait()) set 000000005258daed going to sleep for 11 seconds 00000100:00100000:1.0:1787829737.143686:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284051968 00000100:00100000:1.0:1787829737.143692:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284051968 00000100:00100000:1.0:1787829737.143724:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787829737.143730:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b930e96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+11:5786:x1874675284051968:12345-0@lo:101: 00010000:00010000:1.0:1787829737.143741:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829737.143752:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004c226ed7/0xc03b4d103c0d75bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d75b6 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829737.143772:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004c226ed7/0xc03b4d103c0d75bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d75b6 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829737.143781:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004c226ed7/0xc03b4d103c0d75bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d75b6 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829737.143789:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004c226ed7, rc 0) 00000100:00100000:1.0:1787829737.143822:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b930e96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:5786:x1874675284051968:12345-0@lo:101: Request processed in 92us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829737.143842:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787829737.143949:0:5786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015d4185c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284051968:0@lo:101: 00010000:00010000:2.0:1787829737.143969:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: 00000000d3801099/0xc03b4d103c0d75b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d75bd expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829737.143988:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: 00000000d3801099/0xc03b4d103c0d75b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d75bd expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829737.144066:0:5786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015d4185c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284052096:0@lo:501: 00000100:00100000:2.0:1787829737.144090:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829737.144105:0:5786:0:(client.c:2715:ptlrpc_set_wait()) set 000000005258daed going to sleep for 11 seconds 00000100:00100000:1.0:1787829737.144191:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284052096 00000100:00100000:1.0:1787829737.144196:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284052096 00000100:00100000:1.0:1787829737.144223:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787829737.144229:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000614c4840 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:5786:x1874675284052096:12345-0@lo:501: 00000100:00100000:1.0:1787829737.144513:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000614c4840 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:5786:x1874675284052096:12345-0@lo:501: Request processed in 284us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829737.144520:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787829737.144776:0:5786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015d4185c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284052096:0@lo:501: 00000100:00100000:0.0:1787829737.144802:0:5786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b31a3113 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284052224:0@lo:503: 00000100:00100000:0.0:1787829737.144836:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829737.144887:0:5786:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d5438038 going to sleep for 11 seconds 00000100:00100000:1.0:1787829737.144913:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284052224 00000100:00100000:1.0:1787829737.144917:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284052224 00000100:00100000:1.0:1787829737.144984:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787829737.144990:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f51eb48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:5786:x1874675284052224:12345-0@lo:503: 00000100:00100000:1.0:1787829737.145465:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f51eb48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:5786:x1874675284052224:12345-0@lo:503: Request processed in 474us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829737.145472:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787829737.145640:0:5786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b31a3113 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284052224:0@lo:503: 00000100:00100000:2.0:1787829737.145972:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007073f653 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5833:1874675284052352:0@lo:502: 00000100:00100000:2.0:1787829737.146013:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829737.146198:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 000000000362b7c2 going to sleep for 11 seconds 00000100:00100000:3.0:1787829737.146245:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284052352 00000100:00100000:3.0:1787829737.146250:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284052352 00000100:00100000:3.0:1787829737.146283:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787829737.146290:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebfa05be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:5833:x1874675284052352:12345-0@lo:502: 00000100:00100000:3.0:1787829737.146584:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebfa05be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:5833:x1874675284052352:12345-0@lo:502: Request processed in 293us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829737.146591:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787829737.146662:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007073f653 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5833:1874675284052352:0@lo:502: 00000020:01000004:0.0:1787829737.146718:0:5833:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787829737.146733:0:5833:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000c5380694) 00000020:00000080:0.0:1787829737.146753:0:5833:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787829737.146824:0:5833:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000cfd82227 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787829737.146833:0:5833:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000cfd82227 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787829737.146836:0:5833:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000cfd82227 4 00010000:00080000:0.0:1787829737.146862:0:5833:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000050c3f413@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.151@tcp at head 00010000:00010000:0.0:1787829737.148811:0:5833:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1787829737.149104:0:5833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787829737.149142:0:5833:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787829737.149154:0:5833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc03b4d103c0d75cb 00000100:00080000:0.0:1787829737.149165:0:5833:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787829737.149170:0:5833:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000050c3f413 using connection 192.168.201.151@tcp/0@lo 00000100:00100000:0.0:1787829737.149205:0:5833:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b31a3113 x1874675284052480/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787829737.149228:0:5833:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787829737.149687:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009fbc5326 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5833:1874675284052608:0@lo:502: 00000100:00100000:0.0:1787829737.149761:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829737.149795:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 000000008d8c7de3 going to sleep for 11 seconds 00000100:00100000:0.0:1787829737.149814:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284052608 00000100:00100000:0.0:1787829737.149820:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284052608 00000100:00100000:0.0:1787829737.149863:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787829737.149871:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ebef21e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:5833:x1874675284052608:12345-0@lo:502: 00000100:00100000:0.0:1787829737.150124:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ebef21e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:5833:x1874675284052608:12345-0@lo:502: Request processed in 254us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829737.150132:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787829737.150183:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009fbc5326 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5833:1874675284052608:0@lo:502: 00000040:00080000:0.0:1787829737.150209:0:5833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1787829737.150291:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1787829737.150311:0:5786:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787829737.150324:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: 00000000d3801099/0xc03b4d103c0d75b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d75bd expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829737.150339:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: 00000000d3801099/0xc03b4d103c0d75b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d75bd expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787829737.150378:0:5786:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787829737.150380:0:5786:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787829737.150382:0:5786:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787829737.150383:0:5786:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787829737.150384:0:5786:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787829737.150385:0:5786:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787829737.150386:0:5786:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787829737.150388:0:5786:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787829737.150389:0:5786:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787829737.150390:0:5786:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787829737.150392:0:5786:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787829737.150393:0:5786:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787829737.150396:0:5786:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1787829737.150399:0:5786:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787829737.150400:0:5786:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787829737.150401:0:5786:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787829737.150403:0:5786:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787829737.150404:0:5786:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787829737.150405:0:5786:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787829737.150406:0:5786:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787829737.150407:0:5786:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787829737.150408:0:5786:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787829737.150409:0:5786:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787829737.150409:0:5786:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787829737.150410:0:5786:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787829737.150422:0:5786:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787829737.150429:0:5786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009fbc5326 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284052736:0@lo:253: 00000100:00100000:0.0:1787829737.150458:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829737.150473:0:5786:0:(client.c:2715:ptlrpc_set_wait()) set 000000008d8c7de3 going to sleep for 11 seconds 00000100:00100000:3.0:1787829737.150609:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284052736 00000100:00100000:3.0:1787829737.150613:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284052736 00000100:00100000:3.0:1787829737.150640:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787829737.150646:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d827219 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:5786:x1874675284052736:12345-0@lo:253: 20000000:01000000:3.0:1787829737.150666:0:5798:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787829737.150679:0:5798:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787829737.151642:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b31a3113 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1874675284052480:0@lo:38: 00000100:00100000:1.0:1787829737.151697:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829737.151890:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284052480 00000100:00100000:3.0:1787829737.151895:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284052480 00000100:00100000:3.0:1787829737.151918:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787829737.151923:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df42c200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1874675284052480:12345-0@lo:38: 00000100:00100000:3.0:1787829737.151982:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df42c200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1874675284052480:12345-0@lo:38: Request processed in 58us (284us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787829737.151989:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787829737.152044:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787829737.152059:0:3277:0:(import.c:65:import_set_state_nolock()) 0000000050c3f413 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787829737.152063:0:3277:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787829737.152067:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b31a3113 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1874675284052480:0@lo:38: 20000000:01000000:3.0:1787829737.180443:0:5798:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787829737.180464:0:5798:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787829737.180628:0:5820:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787829737.180633:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787829737.180652:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000027e337e5/0xc03b4d103c0d75d2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829737.180671:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e1643fa7/0xc03b4d103c0d75a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d759a expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829737.180679:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000027e337e5/0xc03b4d103c0d75d2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829737.180734:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e1643fa7/0xc03b4d103c0d75a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d759a expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829737.180750:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e1643fa7/0xc03b4d103c0d75a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d759a expref: 12 pid: 5800 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829737.180765:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d074884 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5820:1874675284052864:0@lo:104: 00000100:00100000:1.0:1787829737.180827:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829737.180886:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b7be05c7 going to sleep for 11 seconds 00000100:00100000:2.0:1787829737.181011:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284052864 00000100:00100000:2.0:1787829737.181048:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284052864 00000100:00100000:2.0:1787829737.181094:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787829737.181102:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000cfe862d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:5820:x1874675284052864:12345-0@lo:104: 00010000:00010000:2.0:1787829737.181113:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: 00000000b9e54895/0xc03b4d103c0d759a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d75a1 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829737.181163:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787829737.181168:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000cfe862d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:5820:x1874675284052864:12345-0@lo:104: Request processed in 68us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829737.181175:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787829737.181264:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d074884 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5820:1874675284052864:0@lo:104: 00010000:00010000:1.0:1787829737.181283:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000027e337e5/0xc03b4d103c0d75d2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829737.181373:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787829737.181379:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: 00000000b9e54895/0xc03b4d103c0d759a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d75a1 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829737.181399:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b9e54895 already unused, calling callback (00000000fedd0922) 10000000:00010000:0.0:1787829737.181402:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: 00000000b9e54895/0xc03b4d103c0d759a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d75a1 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829737.181410:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: 00000000b9e54895/0xc03b4d103c0d759a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d75a1 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787829737.181415:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: 00000000b9e54895/0xc03b4d103c0d759a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d75a1 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787829737.181420:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787829737.181444:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: 00000000b9e54895/0xc03b4d103c0d759a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d75a1 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829737.181450:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787829737.181546:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036d2762f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284052992:0@lo:103: 00000100:00100000:2.0:1787829737.181575:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787829737.181613:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: 00000000b9e54895/0xc03b4d103c0d759a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d75a1 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829737.181620:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: 00000000b9e54895/0xc03b4d103c0d759a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d75a1 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829737.181635:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829737.181637:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829737.181638:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829737.181765:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284052992 00000100:00100000:1.0:1787829737.181769:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284052992 00010000:00010000:1.0:1787829737.181785:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e1643fa7/0xc03b4d103c0d75a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d759a expref: 13 pid: 5800 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829737.181816:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787829737.181822:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e16bd560 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:3279:x1874675284052992:12345-0@lo:103: 00010000:00010000:1.0:1787829737.181833:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829737.181837:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e1643fa7/0xc03b4d103c0d75a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d759a expref: 13 pid: 5800 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829737.181846:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e1643fa7/0xc03b4d103c0d75a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d759a expref: 13 pid: 5800 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829737.181857:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e1643fa7/0xc03b4d103c0d75a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d759a expref: 13 pid: 5800 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829737.181875:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000027e337e5/0xc03b4d103c0d75d2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829737.181882:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000027e337e5/0xc03b4d103c0d75d2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787829737.181894:0:5790:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001262359s 00010000:00010000:1.0:1787829737.181898:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000027e337e5/0xc03b4d103c0d75d2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829737.181904:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000027e337e5/0xc03b4d103c0d75d2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829737.181910:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000027e337e5/0xc03b4d103c0d75d2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829737.181915:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000027e337e5/0xc03b4d103c0d75d2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829737.181920:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000027e337e5 already unused, calling callback (000000008d409c71) 00010000:00010000:1.0:1787829737.181924:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000027e337e5/0xc03b4d103c0d75d2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829737.181930:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000027e337e5/0xc03b4d103c0d75d2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829737.181941:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000027e337e5/0xc03b4d103c0d75d2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829737.181950:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829737.182191:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e16bd560 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:3279:x1874675284052992:12345-0@lo:103: Request processed in 369us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829737.182199:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787829737.182250:0:5820:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000027e337e5/0xc03b4d103c0d75d2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829737.182257:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000027e337e5/0xc03b4d103c0d75d2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829737.182262:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000027e337e5/0xc03b4d103c0d75d2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829737.186608:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d827219 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+11:5786:x1874675284052736:12345-0@lo:253: Request processed in 35954us (36142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829737.186624:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787829737.186746:0:5786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009fbc5326 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5786:1874675284052736:0@lo:253: 10000000:01000000:0.0:1787829737.186761:0:5786:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787829737.186764:0:5786:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787829737.186766:0:5786:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787829737.186767:0:5786:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787829737.186782:0:5786:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787829737.186783:0:5786:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787829737.186785:0:5786:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787829737.186786:0:5786:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787829737.186787:0:5786:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787829737.186788:0:5786:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787829737.186789:0:5786:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787829737.186791:0:5786:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787829737.186792:0:5786:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787829737.186809:0:5786:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787829737.188809:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036d2762f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284052992:0@lo:103: 00080000:10000000:1.0:1787829737.191887:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787829737.192357:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787829737.192581:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787829737.192751:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787829737.192944:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787829737.193163:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787829737.196282:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787829737.196451:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787829737.196730:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787829737.196922:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787829737.197283:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787829737.197464:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1787829737.246523:0:5786:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1787829737.280964:0:5786:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1787829737.281257:0:5839:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:0.0:1787829737.285312:0:5838:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1787829737.285319:0:5838:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787829737.285414:0:5786:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787829737.286671:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787829737.287182:0:5786:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787829737.290388:0:5786:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787829737.290797:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787829737.292838:0:5786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787829737.293424:0:5786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787829737.293455:0:5786:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787829737.293937:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787829737.294157:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1787829737.303381:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787829737.303707:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787829737.303851:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787829737.303984:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787829737.304145:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787829737.304297:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787829737.304433:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787829737.304587:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787829737.304754:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787829737.304903:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787829737.305721:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787829737.305871:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787829737.306229:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787829737.306379:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787829737.307118:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787829737.307416:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787829737.307821:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787829737.308004:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787829737.308972:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787829737.309866:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787829737.310072:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787829737.310224:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787829737.310628:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787829737.310793:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787829737.311157:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787829737.311407:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787829737.311695:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787829737.311839:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787829737.311992:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787829737.312383:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787829737.312850:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787829737.313048:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787829737.313268:0:5786:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1787829737.352651:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1787829737.413979:0:5786:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787829737.414036:0:5786:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbcc5c1c6b988 00100000:10000000:3.0:1787829737.414045:0:5786:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787829737.415625:0:5786:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787829737.415641:0:5786:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.151@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787829737.415657:0:5786:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1787829737.415674:0:5786:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1787829737.489785:0:5839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787829737.489899:0:5839:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787829737.489904:0:5839:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1787829738.147264:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829739.170215:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829740.196296:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829741.221656:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787829741.922185:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787829741.922194:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e9b51a3b000 from 3 10000000:01000000:1.0:1787829741.922200:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787829741.922338:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: 000000003ab7f328/0xc03b4d103c0d75d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829741.922352:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: 000000003ab7f328/0xc03b4d103c0d75d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829741.922375:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: 000000003ab7f328/0xc03b4d103c0d75d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829741.922401:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d074884 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284053120:0@lo:101: 00000100:00100000:1.0:1787829741.922479:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829741.922662:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284053120 00000100:00100000:0.0:1787829741.922670:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284053120 00000100:00100000:0.0:1787829741.922721:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787829741.922729:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b90172cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+11:5802:x1874675284053120:12345-0@lo:101: 00010000:00010000:0.0:1787829741.922742:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829741.922766:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008850a82e/0xc03b4d103c0d75e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d75d9 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829741.922790:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008850a82e/0xc03b4d103c0d75e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d75d9 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829741.922800:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008850a82e/0xc03b4d103c0d75e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d75d9 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829741.922820:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008850a82e, rc 0) 00000100:00100000:0.0:1787829741.922856:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b90172cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:5802:x1874675284053120:12345-0@lo:101: Request processed in 128us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829741.922863:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787829741.923006:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 000000005183b13c going to sleep for 11 seconds 00000100:00100000:1.0:1787829741.923050:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d074884 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284053120:0@lo:101: 00010000:00010000:1.0:1787829741.923066:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: 000000003ab7f328/0xc03b4d103c0d75d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d75e0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829741.923075:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: 000000003ab7f328/0xc03b4d103c0d75d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d75e0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829741.923130:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d074884 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284053248:0@lo:256: 00000100:00100000:1.0:1787829741.923163:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829741.923193:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 000000005183b13c going to sleep for 11 seconds 00000100:00100000:2.0:1787829741.923418:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284053248 00000100:00100000:2.0:1787829741.923424:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284053248 00000100:00100000:2.0:1787829741.923463:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787829741.923470:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075496fbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:5802:x1874675284053248:12345-0@lo:256: 20000000:01000000:2.0:1787829741.923484:0:5800:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787829741.923510:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787829741.923513:0:5800:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1787829741.923672:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075496fbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:5802:x1874675284053248:12345-0@lo:256: Request processed in 203us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829741.923679:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787829741.923919:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d074884 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284053248:0@lo:256: 10000000:01000000:1.0:1787829741.923964:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787829741.923970:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: 000000003ab7f328/0xc03b4d103c0d75d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d75e0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829741.923979:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: 000000003ab7f328/0xc03b4d103c0d75d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d75e0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829742.242498:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787829742.434272:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787829742.434282:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787829742.434285:0:8:0:(import.c:65:import_set_state_nolock()) 0000000050c3f413 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787829742.434297:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000050c3f413 using connection 192.168.201.151@tcp/0@lo 00000100:00100000:3.0:1787829742.434318:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000034c97511 x1874675284053504/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787829742.434358:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000034c97511 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1874675284053504:0@lo:38: 00000100:00100000:3.0:1787829742.434423:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829742.434979:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000364dc2b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284053376:0@lo:400: 00000100:00100000:1.0:1787829742.435035:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829742.437141:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284053376 00000100:00100000:3.0:1787829742.437155:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284053376 00000100:00100000:3.0:1787829742.437219:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787829742.437228:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004f0f341 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:3280:x1874675284053376:12345-0@lo:400: 00000100:00100000:3.0:1787829742.437316:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004f0f341 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:3280:x1874675284053376:12345-0@lo:400: Request processed in 89us (2280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829742.437323:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787829742.437747:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000364dc2b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284053376:0@lo:400: 00000100:00100000:1.0:1787829742.440550:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284053504 00000100:00100000:1.0:1787829742.440566:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284053504 00000100:00100000:1.0:1787829742.440610:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787829742.440617:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025a9a384 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3277:x1874675284053504:12345-0@lo:38: 00010000:00080000:1.0:1787829742.440649:0:5806:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 122 last 0 00000020:00000080:1.0:1787829742.440707:0:5806:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc03b4d103c0d75e7 00000004:00100000:1.0:1787829742.440753:0:5806:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787829742.440949:0:5806:0:(import.c:65:import_set_state_nolock()) 000000000511b342 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787829742.441067:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025a9a384 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1874675284053504:12345-0@lo:38: Request processed in 449us (6644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829742.441074:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787829742.441759:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000034c97511 x1874675284053504/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787829752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787829742.441778:0:3277:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787829742.441785:0:3277:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787829742.441789:0:3277:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787829742.441792:0:3277:0:(import.c:65:import_set_state_nolock()) 0000000050c3f413 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787829742.441797:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000034c97511 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1874675284053504:0@lo:38: 00010000:00010000:2.0:1787829743.270182:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787829743.290750:0:6082:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg151-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787829744.290427:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829745.314398:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829746.338325:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829747.363120:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829747.565844:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787829747.565870:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c2a2f03f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284053632:0@lo:400: 00000100:00100000:0.0:1787829747.565940:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829747.565992:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787829747.566000:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c6358990 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874675284053760:0@lo:400: 00000100:00100000:0.0:1787829747.566054:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829747.566112:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284053632 00000100:00100000:0.0:1787829747.566120:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284053632 00000100:00100000:0.0:1787829747.566170:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787829747.566178:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a29b0bc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:3280:x1874675284053632:12345-0@lo:400: 00000100:00100000:0.0:1787829747.566225:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a29b0bc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:3280:x1874675284053632:12345-0@lo:400: Request processed in 48us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829747.566233:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787829747.566274:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c2a2f03f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284053632:0@lo:400: 00000100:00100000:2.0:1787829747.570248:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284053760 00000100:00100000:2.0:1787829747.570261:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284053760 00000100:00100000:2.0:1787829747.570329:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787829747.570350:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8deb670 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1874675284053760:12345-0@lo:400: 00000100:00100000:2.0:1787829747.570440:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8deb670 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1874675284053760:12345-0@lo:400: Request processed in 91us (4386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829747.570447:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787829747.570476:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c6358990 x1874675284053760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787829763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829747.570492:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c6358990 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874675284053760:0@lo:400: 00010000:00010000:2.0:1787829748.391126:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787829748.623824:0:6285:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf1a2f7c0 20000000:00000080:1.0:1787829748.623843:0:6285:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e9b6015c400 uarg=0000000000000000 20000000:01000000:1.0:1787829748.623883:0:6285:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787829748.623891:0:6285:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787829748.623895:0:6285:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787829748.624460:0:6285:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787829748.624473:0:6285:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1787829748.629464:0:6285:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787829748.629827:0:6285:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787829748.629887:0:6285:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787829748.629939:0:6285:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787829748.629958:0:6285:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787829748.629978:0:6285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000044ac17e5/0xc03b4d103c0d75ee lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829748.629998:0:6285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000defe73cc/0xc03b4d103c0d75af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d75a8 expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829748.630007:0:6285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000044ac17e5/0xc03b4d103c0d75ee lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829748.630187:0:6285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000defe73cc/0xc03b4d103c0d75af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d75a8 expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829748.630202:0:6285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000defe73cc/0xc03b4d103c0d75af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d75a8 expref: 11 pid: 5799 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829748.630217:0:6285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d074884 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6285:1874675284053888:0@lo:104: 00000100:00100000:1.0:1787829748.630282:0:6285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829748.630487:0:6285:0:(client.c:2715:ptlrpc_set_wait()) set 00000000445c84d6 going to sleep for 11 seconds 00000100:00100000:3.0:1787829748.630991:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284053888 00000100:00100000:3.0:1787829748.630999:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284053888 00000100:00100000:3.0:1787829748.631287:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787829748.631304:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009496e1e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:6285:x1874675284053888:12345-0@lo:104: 00010000:00010000:3.0:1787829748.631318:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: 000000001b95ddda/0xc03b4d103c0d75a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d75af expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829748.631394:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787829748.631409:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009496e1e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:6285:x1874675284053888:12345-0@lo:104: Request processed in 115us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829748.631430:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787829748.631566:0:6285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d074884 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6285:1874675284053888:0@lo:104: 00010000:00010000:1.0:1787829748.635089:0:6285:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000044ac17e5/0xc03b4d103c0d75ee lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829748.639711:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787829748.639724:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: 000000001b95ddda/0xc03b4d103c0d75a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d75af expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829748.639739:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001b95ddda already unused, calling callback (00000000fedd0922) 10000000:00010000:2.0:1787829748.639742:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: 000000001b95ddda/0xc03b4d103c0d75a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d75af expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829748.639752:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: 000000001b95ddda/0xc03b4d103c0d75a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d75af expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787829748.639770:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: 000000001b95ddda/0xc03b4d103c0d75a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d75af expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787829748.639776:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787829748.640446:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: 000000001b95ddda/0xc03b4d103c0d75a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d75af expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829748.640456:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787829748.640482:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: 000000001b95ddda/0xc03b4d103c0d75a8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d75af expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829748.640490:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: 000000001b95ddda/0xc03b4d103c0d75a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d75af expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829748.640527:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829748.640529:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829748.640531:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787829748.640560:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787829748.640656:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a41d49e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284054016:0@lo:103: 00000100:00100000:2.0:1787829748.640724:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829748.640803:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284054016 00000100:00100000:2.0:1787829748.640811:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284054016 00010000:00010000:2.0:1787829748.640835:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000defe73cc/0xc03b4d103c0d75af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d75a8 expref: 12 pid: 5799 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829748.640863:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787829748.640870:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000872e0186 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:3278:x1874675284054016:12345-0@lo:103: 00010000:00010000:2.0:1787829748.640882:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829748.640886:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000defe73cc/0xc03b4d103c0d75af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d75a8 expref: 12 pid: 5799 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829748.640896:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000defe73cc/0xc03b4d103c0d75af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d75a8 expref: 12 pid: 5799 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829748.640909:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000defe73cc/0xc03b4d103c0d75af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d75a8 expref: 12 pid: 5799 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829748.640924:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000044ac17e5/0xc03b4d103c0d75ee lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829748.640932:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000044ac17e5/0xc03b4d103c0d75ee lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829748.640958:0:5791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000044ac17e5/0xc03b4d103c0d75ee lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829748.640965:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000044ac17e5/0xc03b4d103c0d75ee lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829748.640971:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000044ac17e5/0xc03b4d103c0d75ee lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829748.640977:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000044ac17e5/0xc03b4d103c0d75ee lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829748.640982:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000044ac17e5 already unused, calling callback (000000008d409c71) 00010000:00010000:2.0:1787829748.640986:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000044ac17e5/0xc03b4d103c0d75ee lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829748.640992:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000044ac17e5/0xc03b4d103c0d75ee lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829748.641006:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000044ac17e5/0xc03b4d103c0d75ee lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829748.641032:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787829748.641066:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000872e0186 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+11:3278:x1874675284054016:12345-0@lo:103: Request processed in 197us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829748.641073:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787829748.641108:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a41d49e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284054016:0@lo:103: 00010000:00010000:2.0:1787829748.642563:0:6285:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000044ac17e5/0xc03b4d103c0d75ee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829748.642664:0:6285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000044ac17e5/0xc03b4d103c0d75ee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829748.642671:0:6285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000044ac17e5/0xc03b4d103c0d75ee lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829749.412649:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829750.440076:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829751.461311:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787829751.906116:0:5802:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787829751.906126:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9b51a3b000 from 1 10000000:01000000:1.0:1787829751.906132:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787829751.906263:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: 000000006eef11f2/0xc03b4d103c0d75f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829751.906279:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: 000000006eef11f2/0xc03b4d103c0d75f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829751.906292:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: 000000006eef11f2/0xc03b4d103c0d75f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829751.906322:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d074884 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284054144:0@lo:101: 00000100:00100000:1.0:1787829751.906413:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829751.906484:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ada1b4e1 going to sleep for 11 seconds 00000100:00100000:0.0:1787829751.906638:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284054144 00000100:00100000:0.0:1787829751.906649:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284054144 00000100:00100000:0.0:1787829751.906721:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787829751.906731:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a6e790e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+11:5802:x1874675284054144:12345-0@lo:101: 00010000:00010000:0.0:1787829751.906749:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829751.906765:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fa36e096/0xc03b4d103c0d75fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d75f5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829751.906794:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fa36e096/0xc03b4d103c0d75fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d75f5 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829751.906805:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fa36e096/0xc03b4d103c0d75fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d75f5 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829751.906816:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fa36e096, rc 0) 00000100:00100000:0.0:1787829751.906871:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a6e790e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:5802:x1874675284054144:12345-0@lo:101: Request processed in 142us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829751.906879:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787829751.907228:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d074884 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284054144:0@lo:101: 00010000:00010000:3.0:1787829751.907257:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: 000000006eef11f2/0xc03b4d103c0d75f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d75fc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829751.907266:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: 000000006eef11f2/0xc03b4d103c0d75f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d75fc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829751.907333:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000095f46e4c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284054272:0@lo:501: 00000100:00100000:3.0:1787829751.907367:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829751.907403:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fd050d04 going to sleep for 11 seconds 00000100:00100000:0.0:1787829751.907504:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284054272 00000100:00100000:0.0:1787829751.907509:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284054272 00000100:00100000:0.0:1787829751.907616:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787829751.907623:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf512bea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:5802:x1874675284054272:12345-0@lo:501: 00000100:00100000:0.0:1787829751.907910:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf512bea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:5802:x1874675284054272:12345-0@lo:501: Request processed in 288us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829751.907918:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787829751.908052:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000095f46e4c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284054272:0@lo:501: 00000100:00100000:3.0:1787829751.908087:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000095f46e4c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284054400:0@lo:503: 00000100:00100000:3.0:1787829751.908132:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829751.908267:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284054400 00000100:00100000:1.0:1787829751.908282:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284054400 00000100:00100000:1.0:1787829751.908312:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787829751.908318:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec8beeac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:5802:x1874675284054400:12345-0@lo:503: 00000100:00100000:3.0:1787829751.908958:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fd050d04 going to sleep for 11 seconds 00000100:00100000:1.0:1787829751.914146:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec8beeac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:5802:x1874675284054400:12345-0@lo:503: Request processed in 5819us (6004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829751.914178:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787829751.914421:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000095f46e4c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284054400:0@lo:503: 00000100:00100000:1.0:1787829751.915191:0:6475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd967422 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6475:1874675284054528:0@lo:502: 00000100:00100000:1.0:1787829751.915458:0:6475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829751.915510:0:6475:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bdf4d58e going to sleep for 11 seconds 00000100:00100000:2.0:1787829751.915683:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284054528 00000100:00100000:2.0:1787829751.915693:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284054528 00000100:00100000:2.0:1787829751.915767:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787829751.915777:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058fe2c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:6475:x1874675284054528:12345-0@lo:502: 00000100:00100000:2.0:1787829751.916007:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058fe2c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:6475:x1874675284054528:12345-0@lo:502: Request processed in 231us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829751.916037:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787829751.916197:0:6475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd967422 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6475:1874675284054528:0@lo:502: 00000020:01000000:1.0:1787829751.916233:0:6475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787829751.916379:0:6475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787829751.916384:0:6475:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787829751.916395:0:6475:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e9b51a3b000 00000020:00000080:1.0:1787829751.916397:0:6475:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787829751.916455:0:6475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6475:1874675284054656:0@lo:502: 00000100:00100000:1.0:1787829751.916503:0:6475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829751.916624:0:6475:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b5a412840 going to sleep for 11 seconds 00000100:00100000:2.0:1787829751.916685:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284054656 00000100:00100000:2.0:1787829751.916690:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284054656 00000100:00100000:2.0:1787829751.916740:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787829751.916748:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:6475:x1874675284054656:12345-0@lo:502: 00000100:00100000:2.0:1787829751.916932:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:6475:x1874675284054656:12345-0@lo:502: Request processed in 184us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829751.916941:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787829751.918489:0:6475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6475:1874675284054656:0@lo:502: 00000020:01000000:3.0:1787829751.918615:0:6475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787829751.918623:0:6475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787829751.918626:0:6475:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787829751.918630:0:6475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787829751.918818:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787829751.918840:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787829751.918853:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdba00/0xc03b4d103c0d75f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d75fc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829751.918866:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdba00/0xc03b4d103c0d75f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d75fc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829752.483240:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787829752.674663:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b59693c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874675284054912:0@lo:400: 00000100:00100000:2.0:1787829752.674767:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829752.674845:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787829752.674851:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b596921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3281:1874675284054784:0@lo:400: 00000100:00100000:2.0:1787829752.674880:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829752.674969:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284054784 00000100:00100000:1.0:1787829752.674980:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284054784 00000100:00100000:1.0:1787829752.675075:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787829752.675095:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:3281:x1874675284054784:12345-0@lo:400: 00000100:00100000:1.0:1787829752.675152:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:3281:x1874675284054784:12345-0@lo:400: Request processed in 68us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829752.675160:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787829752.675282:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b596921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3281:1874675284054784:0@lo:400: 00000100:00100000:3.0:1787829752.675358:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284054912 00000100:00100000:3.0:1787829752.675363:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284054912 00000100:00100000:3.0:1787829752.675396:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787829752.675403:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874675284054912:12345-0@lo:400: 00000100:00100000:3.0:1787829752.675471:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874675284054912:12345-0@lo:400: Request processed in 69us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829752.675478:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787829752.675538:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e9b59693c00 x1874675284054912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787829768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829752.675552:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b59693c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874675284054912:0@lo:400: 00010000:00010000:3.0:1787829753.513129:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829754.532496:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829755.565547:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787829755.918695:0:6647:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787829755.918699:0:6647:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1787829755.918817:0:6647:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e9b53977800 00000020:01000004:0.0:1787829755.918832:0:6647:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787829755.918857:0:6647:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787829755.918881:0:6647:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9e9b69c2cd28) 00000020:00000080:0.0:1787829755.918898:0:6647:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787829755.954167:0:6647:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787829755.954431:0:6647:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787829756.021865:0:6647:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787829756.039520:0:6647:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787829756.039557:0:6647:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787829756.039641:0:6647:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787829756.039690:0:6647:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787829756.043670:0:6647:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787829756.043683:0:6647:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787829756.043695:0:6647:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc03b4d103c0d760a 00000020:01000004:3.0:1787829756.043704:0:6647:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787829756.043725:0:6647:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.151@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787829756.043729:0:6647:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787829756.043736:0:6647:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787829756.043740:0:6647:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787829756.043753:0:6647:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9e9b6fb9b370) 00000020:00000080:3.0:1787829756.043763:0:6647:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1787829756.052494:0:6647:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787829756.052687:0:6647:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787829756.052694:0:6647:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787829756.061903:0:6647:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787829756.061944:0:6647:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787829756.062596:0:6647:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787829756.062603:0:6647:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787829756.064604:0:6647:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787829756.065395:0:6647:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787829756.065402:0:6647:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787829756.068583:0:6647:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787829756.068596:0:6647:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787829756.127567:0:6647:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787829756.129137:0:6647:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787829756.129152:0:6647:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787829756.133815:0:6647:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787829756.133831:0:6647:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787829756.145309:0:6647:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787829756.145325:0:6647:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787829756.152367:0:6647:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787829756.152573:0:6647:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787829756.152581:0:6647:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787829756.159876:0:6647:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787829756.159890:0:6647:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787829756.248859:0:6647:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787829756.249604:0:6647:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787829756.249614:0:6647:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787829756.267284:0:6647:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787829756.267300:0:6647:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787829756.270438:0:6647:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787829756.270459:0:6647:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787829756.270465:0:6647:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.151@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787829756.298833:0:6647:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.151@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787829756.298871:0:6647:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.151@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1787829756.298874:0:6647:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787829756.298876:0:6647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787829756.298877:0:6647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787829756.298879:0:6647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787829756.298880:0:6647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787829756.298886:0:6647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787829756.298887:0:6647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787829756.298888:0:6647:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787829756.298890:0:6647:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787829756.298891:0:6647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787829756.298893:0:6647:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787829756.298896:0:6647:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1787829756.298898:0:6647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787829756.298899:0:6647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787829756.298900:0:6647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787829756.298901:0:6647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787829756.298902:0:6647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787829756.298903:0:6647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787829756.298904:0:6647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787829756.298905:0:6647:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787829756.298905:0:6647:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787829756.298906:0:6647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787829756.298907:0:6647:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787829756.298933:0:6647:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787829756.298952:0:6647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b59691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284055040:0@lo:253: 00000100:00100000:3.0:1787829756.299051:0:6647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829756.299094:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284055040 00000100:00100000:3.0:1787829756.299095:0:6647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51d40b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787829756.299102:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284055040 00000100:00100000:1.0:1787829756.299158:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787829756.299168:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:6647:x1874675284055040:12345-0@lo:253: 20000000:01000000:1.0:1787829756.299222:0:5798:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787829756.299226:0:5798:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787829756.299232:0:5798:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787829756.299235:0:5798:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787829756.300094:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787829756.300276:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787829756.300289:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787829756.300322:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1787829756.300329:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787829756.300353:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1787829756.300393:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1787829756.300732:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787829756.300751:0:5798:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.151@tcp 20000000:01000000:1.0:1787829756.300753:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.151@tcp (null) (null) (null) 00000040:00080000:1.0:1787829756.300802:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1787829756.300810:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787829756.300859:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1787829756.300874:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.151@tcp (null) (null) 00000040:00080000:1.0:1787829756.300910:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787829756.300920:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787829756.300945:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1787829756.300986:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1787829756.301775:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787829756.301796:0:5798:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.151@tcp 20000000:01000000:1.0:1787829756.301798:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.151@tcp (null) (null) (null) 00000040:00080000:1.0:1787829756.301831:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1787829756.301839:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787829756.301864:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787829756.301871:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.151@tcp (null) (null) 00000040:00080000:1.0:1787829756.301921:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787829756.301931:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787829756.301959:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1787829756.301986:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1787829756.302000:0:5798:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787829756.302003:0:5798:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787829756.302006:0:5798:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787829756.302048:0:5798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787829756.302051:0:5798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787829756.302081:0:5798:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787829756.302084:0:5798:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787829756.303139:0:6662:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1787829756.303205:0:6662:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1787829756.303345:0:6662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1787829756.303789:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1787829756.303835:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1787829756.303894:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1787829756.303910:0:5798:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787829756.303912:0:5798:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787829756.305603:0:6663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1787829756.306224:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1787829756.308638:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1787829756.308881:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1787829756.308903:0:5798:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787829756.308905:0:5798:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787829756.309672:0:6664:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787829756.309727:0:6664:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787829756.309781:0:6664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787829756.310183:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1787829756.310231:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1787829756.310301:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1787829756.310318:0:5798:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1787829756.310327:0:5798:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1787829756.310337:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787829756.310357:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e9b48cdb400/0xc03b4d103c0d7618 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829756.310374:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b596cac00/0xc03b4d103c0d7531 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d752a expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829756.310381:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b40031e00/0xc03b4d103c0d754d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7546 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829756.310388:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d75bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d75b6 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829756.310396:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e9b48cdb400/0xc03b4d103c0d7618 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829756.310436:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d75bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d75b6 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829756.310451:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d75bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d75b6 expref: 12 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829756.310465:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955e1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5798:1874675284055168:0@lo:104: 00000100:00100000:1.0:1787829756.310530:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787829756.310596:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b40031e00/0xc03b4d103c0d754d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d7546 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829756.310604:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e9b40031e00/0xc03b4d103c0d754d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d7546 expref: 12 pid: 5800 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829756.310612:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955fc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5798:1874675284055296:0@lo:104: 00000100:00100000:1.0:1787829756.310673:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787829756.310700:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b596cac00/0xc03b4d103c0d7531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d752a expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829756.310709:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e9b596cac00/0xc03b4d103c0d7531 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d752a expref: 12 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829756.310717:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955f840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5798:1874675284055424:0@lo:104: 00000100:00100000:1.0:1787829756.310736:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829756.310747:0:5798:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fa50b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787829756.310834:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284055168 00000100:00100000:3.0:1787829756.310842:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284055168 00000100:00100000:3.0:1787829756.310873:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284055296 00000100:00100000:3.0:1787829756.310876:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284055296 00000100:00100000:3.0:1787829756.310885:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284055424 00000100:00100000:3.0:1787829756.310893:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284055424 00000100:00100000:3.0:1787829756.310912:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787829756.310921:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+5:5798:x1874675284055168:12345-0@lo:104: 00010000:00010000:3.0:1787829756.310933:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fc00/0xc03b4d103c0d75b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d75bd expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.310993:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787829756.310999:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+5:5798:x1874675284055168:12345-0@lo:104: Request processed in 79us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829756.311005:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787829756.311038:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787829756.311044:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+4:5798:x1874675284055296:12345-0@lo:104: 00010000:00010000:3.0:1787829756.311051:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdaa00/0xc03b4d103c0d7546 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d754d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311081:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787829756.311085:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+4:5798:x1874675284055296:12345-0@lo:104: Request processed in 43us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829756.311091:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787829756.311102:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787829756.311108:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:5798:x1874675284055424:12345-0@lo:104: 00010000:00010000:3.0:1787829756.311114:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d752a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d7531 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311140:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787829756.311144:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:5798:x1874675284055424:12345-0@lo:104: Request processed in 37us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829756.311149:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787829756.311173:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787829756.311180:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fc00/0xc03b4d103c0d75b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d75bd expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311187:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164fc00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:3.0:1787829756.311191:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fc00/0xc03b4d103c0d75b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d75bd expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311200:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fc00/0xc03b4d103c0d75b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d75bd expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787829756.311207:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fc00/0xc03b4d103c0d75b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d75bd expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787829756.311214:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787829756.311241:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fc00/0xc03b4d103c0d75b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d75bd expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311247:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787829756.311265:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fc00/0xc03b4d103c0d75b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d75bd expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311272:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fc00/0xc03b4d103c0d75b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d75bd expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311284:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787829756.311288:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdaa00/0xc03b4d103c0d7546 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d754d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311294:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b48cdaa00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:3.0:1787829756.311296:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdaa00/0xc03b4d103c0d7546 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d754d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311310:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdaa00/0xc03b4d103c0d7546 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d754d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787829756.311316:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdaa00/0xc03b4d103c0d7546 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d754d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787829756.311321:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787829756.311335:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdaa00/0xc03b4d103c0d7546 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d754d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311340:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787829756.311345:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdaa00/0xc03b4d103c0d7546 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d754d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311351:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdaa00/0xc03b4d103c0d7546 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d754d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311361:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787829756.311364:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d752a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d7531 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311369:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b48cda000 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:3.0:1787829756.311372:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d752a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d7531 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311378:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d752a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d7531 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787829756.311383:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d752a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d7531 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787829756.311395:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787829756.311407:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d752a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7531 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311412:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787829756.311425:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d752a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7531 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311432:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d752a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7531 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311444:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829756.311446:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829756.311447:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787829756.311459:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b59692d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284055680:0@lo:103: 00000100:00100000:3.0:1787829756.311487:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829756.311507:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787829756.311512:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b59692580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284055552:0@lo:103: 00000100:00100000:3.0:1787829756.311528:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829756.311551:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b596912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284055808:0@lo:103: 00000100:00100000:3.0:1787829756.311571:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829756.311603:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284055680 00000100:00100000:3.0:1787829756.311606:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284055680 00010000:00010000:3.0:1787829756.311638:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b40031e00/0xc03b4d103c0d754d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d7546 expref: 13 pid: 5800 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829756.311652:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284055552 00000100:00100000:3.0:1787829756.311655:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284055552 00010000:00010000:3.0:1787829756.311673:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d75bd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d75b6 expref: 14 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829756.311684:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284055808 00000100:00100000:3.0:1787829756.311686:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284055808 00010000:00010000:3.0:1787829756.311695:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b596cac00/0xc03b4d103c0d7531 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d752a expref: 15 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829756.311706:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787829756.311712:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b59690000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:3279:x1874675284055680:12345-0@lo:103: 00010000:00010000:3.0:1787829756.311722:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829756.311726:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b40031e00/0xc03b4d103c0d754d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d7546 expref: 15 pid: 5800 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311736:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b40031e00/0xc03b4d103c0d754d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d7546 expref: 15 pid: 5800 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311751:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787829756.311780:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b59690000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:3279:x1874675284055680:12345-0@lo:103: Request processed in 68us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829756.311785:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787829756.311798:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787829756.311803:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b59690f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:3279:x1874675284055552:12345-0@lo:103: 00010000:00010000:3.0:1787829756.311811:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829756.311815:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d75bd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d75b6 expref: 14 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311823:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d75bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d75b6 expref: 14 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311843:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787829756.311867:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b59690f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:3279:x1874675284055552:12345-0@lo:103: Request processed in 63us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829756.311872:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787829756.311883:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787829756.311889:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b596903c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:3280:x1874675284055808:12345-0@lo:103: 00010000:00010000:3.0:1787829756.311896:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829756.311900:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b596cac00/0xc03b4d103c0d7531 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d752a expref: 13 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311909:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b596cac00/0xc03b4d103c0d7531 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d752a expref: 13 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311919:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e9b48cdb400/0xc03b4d103c0d7618 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311926:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b48cdb400/0xc03b4d103c0d7618 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311938:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b48cdb400/0xc03b4d103c0d7618 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311944:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b48cdb400/0xc03b4d103c0d7618 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311951:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e9b48cdb400/0xc03b4d103c0d7618 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311956:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e9b48cdb400/0xc03b4d103c0d7618 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311967:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b48cdb400 already unused, calling callback (ffffffffc1651420) 00010000:00010000:3.0:1787829756.311971:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e9b48cdb400/0xc03b4d103c0d7618 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311978:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e9b48cdb400/0xc03b4d103c0d7618 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311987:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e9b48cdb400/0xc03b4d103c0d7618 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.311996:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787829756.312050:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b596903c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:3280:x1874675284055808:12345-0@lo:103: Request processed in 161us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829756.312057:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787829756.312090:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b596912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284055808:0@lo:103: 00000100:00100000:3.0:1787829756.312115:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b59692580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284055552:0@lo:103: 00000100:00100000:3.0:1787829756.312122:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b59692d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284055680:0@lo:103: 00010000:00010000:1.0:1787829756.312302:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d75bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d75b6 expref: 12 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829756.312314:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955e1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5798:1874675284055168:0@lo:104: 00010000:00010000:1.0:1787829756.312324:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b40031e00/0xc03b4d103c0d754d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d7546 expref: 11 pid: 5800 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829756.312332:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955fc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5798:1874675284055296:0@lo:104: 00010000:00010000:1.0:1787829756.312339:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b596cac00/0xc03b4d103c0d7531 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d752a expref: 10 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829756.312346:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955f840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5798:1874675284055424:0@lo:104: 00010000:00010000:1.0:1787829756.312364:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e9b48cdb400/0xc03b4d103c0d7618 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829756.312373:0:5798:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e9b48cdb400/0xc03b4d103c0d7618 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829756.312378:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e9b48cdb400/0xc03b4d103c0d7618 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829756.312391:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b48cdb400/0xc03b4d103c0d7618 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787829756.312405:0:5798:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:0.0:1787829756.312496:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787829756.368248:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+9:6647:x1874675284055040:12345-0@lo:253: Request processed in 69072us (69187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829756.368411:0:6647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b59691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284055040:0@lo:253: 10000000:01000000:3.0:1787829756.368431:0:6647:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787829756.368435:0:6647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787829756.368436:0:6647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787829756.368438:0:6647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787829756.368439:0:6647:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1787829756.368441:0:6647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787829756.368442:0:6647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787829756.368443:0:6647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787829756.368445:0:6647:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787829756.368447:0:6647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787829756.368461:0:6647:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787829756.368480:0:6647:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e9b53977800 from lustre-OST0000 10000000:01000000:3.0:1787829756.368515:0:6647:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787829756.368519:0:6647:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787829756.368526:0:6647:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e9b4f8419b8 local copy 10000000:01000000:3.0:1787829756.368530:0:6647:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787829756.368570:0:6647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb400/0xc03b4d103c0d761f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.368581:0:6647:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb400/0xc03b4d103c0d761f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.368590:0:6647:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb400/0xc03b4d103c0d761f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829756.368607:0:6647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b59691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284055936:0@lo:101: 00000100:00100000:3.0:1787829756.368656:0:6647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829756.368699:0:6647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51d40780 going to sleep for 11 seconds 00000100:00100000:2.0:1787829756.368808:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787829756.368838:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284055936 00000100:00100000:2.0:1787829756.368844:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284055936 00000100:00100000:2.0:1787829756.368888:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787829756.368896:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+9:6647:x1874675284055936:12345-0@lo:101: 00010000:00010000:2.0:1787829756.368907:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829756.368927:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b4164e600/0xc03b4d103c0d7626 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d761f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829756.368949:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b4164e600/0xc03b4d103c0d7626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d761f expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829756.368960:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b4164e600/0xc03b4d103c0d7626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d761f expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829756.368968:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164e600, rc 0) 00000100:00100000:2.0:1787829756.368998:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+10:6647:x1874675284055936:12345-0@lo:101: Request processed in 103us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829756.369004:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787829756.369351:0:6647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b59691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284055936:0@lo:101: 00010000:00010000:3.0:1787829756.369365:0:6647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb400/0xc03b4d103c0d761f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc03b4d103c0d7626 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.369375:0:6647:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb400/0xc03b4d103c0d761f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc03b4d103c0d7626 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829756.369470:0:6647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b59691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284056064:0@lo:501: 00000100:00100000:3.0:1787829756.369499:0:6647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829756.369529:0:6647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51d40780 going to sleep for 11 seconds 00000100:00100000:2.0:1787829756.369583:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284056064 00000100:00100000:2.0:1787829756.369586:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284056064 00000100:00100000:2.0:1787829756.369618:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787829756.369648:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+10:6647:x1874675284056064:12345-0@lo:501: 00000100:00100000:2.0:1787829756.369906:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+10:6647:x1874675284056064:12345-0@lo:501: Request processed in 282us (405us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787829756.369914:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787829756.370491:0:6647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b59691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284056064:0@lo:501: 10000000:01000000:3.0:1787829756.370507:0:6647:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787829756.370546:0:6647:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787829756.370552:0:6647:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb400/0xc03b4d103c0d761f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc03b4d103c0d7626 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.370560:0:6647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb400/0xc03b4d103c0d761f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc03b4d103c0d7626 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.370568:0:6647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb400/0xc03b4d103c0d761f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc03b4d103c0d7626 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.370638:0:6647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787829756.370658:0:6647:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e9b53977800 10000000:01000000:3.0:1787829756.370663:0:6647:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787829756.370669:0:6647:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9e9b4f8419b8 10000000:01000000:3.0:1787829756.370671:0:6647:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787829756.370674:0:6647:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e9b4f8419b8 from 1 10000000:01000000:3.0:1787829756.370677:0:6647:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787829756.370699:0:6647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b596cba00/0xc03b4d103c0d762d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.370706:0:6647:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b596cba00/0xc03b4d103c0d762d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.370715:0:6647:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b596cba00/0xc03b4d103c0d762d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829756.370729:0:6647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b59691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284056192:0@lo:101: 00000100:00100000:3.0:1787829756.370764:0:6647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829756.370835:0:6647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51d400c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787829756.370875:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787829756.370882:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb400/0xc03b4d103c0d761f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc03b4d103c0d7626 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829756.370889:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b596cb400 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:0.0:1787829756.370893:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb400/0xc03b4d103c0d761f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc03b4d103c0d7626 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829756.370902:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb400/0xc03b4d103c0d761f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xc03b4d103c0d7626 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787829756.370909:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb400/0xc03b4d103c0d761f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xc03b4d103c0d7626 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787829756.370929:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787829756.370950:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb400/0xc03b4d103c0d761f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc03b4d103c0d7626 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829756.370956:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787829756.370983:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb400/0xc03b4d103c0d761f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc03b4d103c0d7626 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829756.370989:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb400/0xc03b4d103c0d761f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc03b4d103c0d7626 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829756.371004:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829756.371005:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829756.371007:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787829756.371099:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787829756.371117:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284056320:0@lo:103: 00000100:00100000:3.0:1787829756.371145:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829756.371238:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284056320 00000100:00100000:0.0:1787829756.371243:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284056320 00000100:00100000:0.0:1787829756.371300:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787829756.371308:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b59692d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+10:3280:x1874675284056320:12345-0@lo:103: 00010000:00010000:0.0:1787829756.371320:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829756.371333:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b4164e600/0xc03b4d103c0d7626 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc03b4d103c0d761f expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829756.371347:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829756.371381:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b59692d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+9:3280:x1874675284056320:12345-0@lo:103: Request processed in 74us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829756.371388:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787829756.371514:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284056320:0@lo:103: 00000100:00100000:1.0:1787829756.371798:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284056192 00000100:00100000:1.0:1787829756.371803:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284056192 00000100:00100000:0.0:1787829756.371923:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787829756.371931:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+9:6647:x1874675284056192:12345-0@lo:101: 00010000:00010000:0.0:1787829756.371954:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829756.371966:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b40031a00/0xc03b4d103c0d7634 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d762d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829756.371985:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b40031a00/0xc03b4d103c0d7634 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d762d expref: 10 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829756.371996:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b40031a00/0xc03b4d103c0d7634 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d762d expref: 10 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829756.372003:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b40031a00, rc 0) 00000100:00100000:0.0:1787829756.372076:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+10:6647:x1874675284056192:12345-0@lo:101: Request processed in 146us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829756.372082:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787829756.372150:0:6647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b59691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284056192:0@lo:101: 00010000:00010000:3.0:1787829756.372175:0:6647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b596cba00/0xc03b4d103c0d762d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7634 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.372182:0:6647:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b596cba00/0xc03b4d103c0d762d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d7634 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787829756.372198:0:6647:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787829756.372217:0:6647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b596cba00/0xc03b4d103c0d762d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7634 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.372223:0:6647:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b596cba00/0xc03b4d103c0d762d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7634 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787829756.372229:0:6647:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787829756.372233:0:6647:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787829756.372238:0:6647:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787829756.372241:0:6647:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787829756.372264:0:6647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b596cbc00/0xc03b4d103c0d763b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.372272:0:6647:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b596cbc00/0xc03b4d103c0d763b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.372279:0:6647:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b596cbc00/0xc03b4d103c0d763b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829756.372304:0:6647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b59691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284056448:0@lo:101: 00000100:00100000:3.0:1787829756.372332:0:6647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829756.372612:0:6647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51d400c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787829756.372683:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284056448 00000100:00100000:2.0:1787829756.372689:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284056448 00000100:00100000:2.0:1787829756.372713:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787829756.372720:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+10:6647:x1874675284056448:12345-0@lo:101: 00010000:00010000:2.0:1787829756.372728:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829756.372737:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b4164e000/0xc03b4d103c0d7642 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d763b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829756.372751:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b4164e000/0xc03b4d103c0d7642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d763b expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829756.372767:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b4164e000/0xc03b4d103c0d7642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d763b expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829756.372774:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164e000, rc 0) 00000100:00100000:2.0:1787829756.372815:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+11:6647:x1874675284056448:12345-0@lo:101: Request processed in 95us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829756.372821:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787829756.372899:0:6647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b59691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284056448:0@lo:101: 00010000:00010000:3.0:1787829756.372911:0:6647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b596cbc00/0xc03b4d103c0d763b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7642 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.372917:0:6647:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b596cbc00/0xc03b4d103c0d763b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d7642 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829756.373036:0:6647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b59691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284056576:0@lo:501: 00000100:00100000:3.0:1787829756.373076:0:6647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829756.373091:0:6647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51d400c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787829756.373379:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284056576 00000100:00100000:2.0:1787829756.373384:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284056576 00000100:00100000:2.0:1787829756.373403:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787829756.373409:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+11:6647:x1874675284056576:12345-0@lo:501: 00000100:00100000:2.0:1787829756.373641:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+11:6647:x1874675284056576:12345-0@lo:501: Request processed in 231us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829756.373648:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787829756.373891:0:6647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b59691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284056576:0@lo:501: 00000100:00100000:3.0:1787829756.373922:0:6647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b59691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284056704:0@lo:503: 00000100:00100000:3.0:1787829756.373960:0:6647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829756.373980:0:6647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51d400c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787829756.374511:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284056704 00000100:00100000:2.0:1787829756.374516:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284056704 00000100:00100000:2.0:1787829756.374540:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787829756.374547:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+11:6647:x1874675284056704:12345-0@lo:503: 00000100:00100000:2.0:1787829756.374716:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+11:6647:x1874675284056704:12345-0@lo:503: Request processed in 168us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829756.374723:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787829756.374852:0:6647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b59691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284056704:0@lo:503: 00000040:00080000:3.0:1787829756.375153:0:6647:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787829756.375231:0:6647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b59691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284056832:0@lo:502: 00000100:00100000:3.0:1787829756.375511:0:6647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829756.375535:0:6647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51d400c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787829756.375608:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284056832 00000100:00100000:2.0:1787829756.375613:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284056832 00000100:00100000:2.0:1787829756.375646:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787829756.375654:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+11:6647:x1874675284056832:12345-0@lo:502: 00000100:00100000:2.0:1787829756.375921:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+11:6647:x1874675284056832:12345-0@lo:502: Request processed in 268us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829756.375934:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787829756.376497:0:6647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b59691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284056832:0@lo:502: 00000040:00080000:3.0:1787829756.376786:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787829756.376849:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787829756.376886:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787829756.376950:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787829756.376986:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787829756.377164:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787829756.377377:0:6647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b59691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284056960:0@lo:502: 00000100:00100000:3.0:1787829756.377435:0:6647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829756.377613:0:6647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51d400c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787829756.377698:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284056960 00000100:00100000:0.0:1787829756.377704:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284056960 00000100:00100000:0.0:1787829756.377800:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787829756.377809:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+11:6647:x1874675284056960:12345-0@lo:502: 00000100:00100000:0.0:1787829756.377992:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+11:6647:x1874675284056960:12345-0@lo:502: Request processed in 185us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829756.378000:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787829756.378108:0:6647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b59691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284056960:0@lo:502: 00000040:00080000:3.0:1787829756.378235:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787829756.378246:0:6647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1787829756.379081:0:6665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787829756.379090:0:6665:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787829756.379096:0:6665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787829756.379099:0:6665:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787829756.379103:0:6665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787829756.379125:0:6665:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9e9b7f580000) 00000020:00000080:3.0:1787829756.379145:0:6665:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787829756.379152:0:6665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787829756.379331:0:6665:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e9b53977800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787829756.379338:0:6665:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787829756.379345:0:6665:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc03b4d103c0d7650 00010000:00010000:3.0:1787829756.384745:0:6665:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1787829756.385605:0:6665:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787829756.387978:0:6665:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787829756.388387:0:6665:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1787829756.392764:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787829756.393727:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787829756.394922:0:6665:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787829756.394931:0:6665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787829756.394939:0:6665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787829756.394940:0:6665:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787829756.394943:0:6665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787829756.394946:0:6665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787829756.394947:0:6665:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787829756.394949:0:6665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787829756.394950:0:6665:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787829756.394988:0:6665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787829756.394990:0:6665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787829756.394991:0:6665:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787829756.394993:0:6665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787829756.395120:0:6647:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1787829756.395139:0:6647:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787829756.395156:0:6647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b596cbc00/0xc03b4d103c0d763b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7642 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829756.395178:0:6647:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b596cbc00/0xc03b4d103c0d763b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7642 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787829756.395186:0:6647:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9b53977800 from 1 10000000:01000000:1.0:1787829756.395189:0:6647:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787829756.395226:0:6647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb400/0xc03b4d103c0d7657 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829756.395234:0:6647:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb400/0xc03b4d103c0d7657 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829756.395245:0:6647:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb400/0xc03b4d103c0d7657 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829756.395388:0:6647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284057088:0@lo:101: 00000100:00100000:1.0:1787829756.395442:0:6647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829756.395486:0:6647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fa50b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787829756.395489:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284057088 00000100:00100000:2.0:1787829756.395496:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284057088 00000100:00100000:2.0:1787829756.395542:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787829756.395552:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+11:6647:x1874675284057088:12345-0@lo:101: 00010000:00010000:2.0:1787829756.395565:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829756.395579:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b4164ec00/0xc03b4d103c0d765e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d7657 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829756.395602:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b4164ec00/0xc03b4d103c0d765e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d7657 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829756.395614:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b4164ec00/0xc03b4d103c0d765e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7657 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829756.395631:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164ec00, rc 0) 00000100:00100000:2.0:1787829756.395736:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:6647:x1874675284057088:12345-0@lo:101: Request processed in 126us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829756.395745:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787829756.396381:0:6647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284057088:0@lo:101: 00010000:00010000:3.0:1787829756.396398:0:6647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb400/0xc03b4d103c0d7657 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d765e expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.396408:0:6647:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb400/0xc03b4d103c0d7657 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d765e expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829756.396502:0:6647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b59691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284057216:0@lo:501: 00000100:00100000:3.0:1787829756.396534:0:6647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829756.396551:0:6647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51d403c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787829756.396676:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284057216 00000100:00100000:2.0:1787829756.396680:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284057216 00000100:00100000:2.0:1787829756.396787:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787829756.396795:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:6647:x1874675284057216:12345-0@lo:501: 00000100:00100000:2.0:1787829756.397034:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:6647:x1874675284057216:12345-0@lo:501: Request processed in 221us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829756.397041:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787829756.397110:0:6647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b59691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284057216:0@lo:501: 00000100:00100000:1.0:1787829756.397149:0:6647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284057344:0@lo:503: 00000100:00100000:1.0:1787829756.397202:0:6647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829756.397421:0:6647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fa50780 going to sleep for 11 seconds 00000100:00100000:3.0:1787829756.397454:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284057344 00000100:00100000:3.0:1787829756.397458:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284057344 00000100:00100000:3.0:1787829756.397477:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787829756.397483:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:6647:x1874675284057344:12345-0@lo:503: 00000100:00100000:3.0:1787829756.397741:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:6647:x1874675284057344:12345-0@lo:503: Request processed in 255us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829756.397749:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787829756.397861:0:6647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284057344:0@lo:503: 00000040:00080000:1.0:1787829756.398441:0:6647:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787829756.398499:0:6647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284057472:0@lo:502: 00000100:00100000:1.0:1787829756.398542:0:6647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829756.398608:0:6647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fa50780 going to sleep for 11 seconds 00000100:00100000:3.0:1787829756.398654:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284057472 00000100:00100000:3.0:1787829756.398659:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284057472 00000100:00100000:3.0:1787829756.398734:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787829756.398743:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:6647:x1874675284057472:12345-0@lo:502: 00000100:00100000:3.0:1787829756.398894:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:6647:x1874675284057472:12345-0@lo:502: Request processed in 152us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829756.398901:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787829756.398970:0:6647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284057472:0@lo:502: 00000040:00080000:1.0:1787829756.399232:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787829756.399292:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787829756.399315:0:6647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284057600:0@lo:502: 00000100:00100000:1.0:1787829756.399350:0:6647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829756.399599:0:6647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fa50780 going to sleep for 11 seconds 00000100:00100000:2.0:1787829756.399636:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284057600 00000100:00100000:2.0:1787829756.399641:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284057600 00000100:00100000:2.0:1787829756.399669:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787829756.399675:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:6647:x1874675284057600:12345-0@lo:502: 00000100:00100000:2.0:1787829756.399854:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:6647:x1874675284057600:12345-0@lo:502: Request processed in 177us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829756.399860:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787829756.400103:0:6647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284057600:0@lo:502: 00000040:00080000:1.0:1787829756.401118:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787829756.401132:0:6647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787829756.406150:0:6669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787829756.406356:0:6669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787829756.406359:0:6669:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787829756.406367:0:6669:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e9b53977800 00000020:00000080:1.0:1787829756.406369:0:6669:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787829756.406398:0:6669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787829756.406402:0:6669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787829756.406403:0:6669:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787829756.406406:0:6669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787829756.406544:0:6647:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787829756.406572:0:6647:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787829756.406597:0:6647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb400/0xc03b4d103c0d7657 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d765e expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829756.406609:0:6647:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb400/0xc03b4d103c0d7657 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d765e expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787829756.406660:0:6647:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787829756.406663:0:6647:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e9b53977800 10000000:01000000:2.0:1787829756.406666:0:6647:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e9b53977800 10000000:01000000:2.0:1787829756.406670:0:6647:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787829756.406675:0:6647:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e9b53977800 from 1 10000000:01000000:2.0:1787829756.406678:0:6647:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787829756.406713:0:6647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7665 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829756.406721:0:6647:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7665 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829756.406731:0:6647:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7665 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829756.406753:0:6647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284057728:0@lo:101: 00000100:00100000:2.0:1787829756.406817:0:6647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829756.406878:0:6647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b75ca4540 going to sleep for 11 seconds 00000100:00100000:3.0:1787829756.406930:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284057728 00000100:00100000:3.0:1787829756.406938:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284057728 00000100:00100000:3.0:1787829756.406983:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787829756.406993:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:6647:x1874675284057728:12345-0@lo:101: 00010000:00010000:3.0:1787829756.407007:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829756.407045:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b596cb200/0xc03b4d103c0d766c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d7665 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.407070:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b596cb200/0xc03b4d103c0d766c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d7665 expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.407079:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b596cb200/0xc03b4d103c0d766c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7665 expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.407087:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b596cb200, rc 0) 00000100:00100000:3.0:1787829756.407125:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:6647:x1874675284057728:12345-0@lo:101: Request processed in 134us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829756.407132:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787829756.407290:0:6647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284057728:0@lo:101: 00010000:00010000:2.0:1787829756.407305:0:6647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7665 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d766c expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829756.407314:0:6647:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7665 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d766c expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829756.407434:0:6647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284057856:0@lo:501: 00000100:00100000:2.0:1787829756.407459:0:6647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829756.407477:0:6647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b75ca4540 going to sleep for 11 seconds 00000100:00100000:3.0:1787829756.407582:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284057856 00000100:00100000:3.0:1787829756.407588:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284057856 00000100:00100000:3.0:1787829756.407617:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787829756.407633:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:6647:x1874675284057856:12345-0@lo:501: 00000100:00100000:3.0:1787829756.407853:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:6647:x1874675284057856:12345-0@lo:501: Request processed in 221us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829756.407866:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787829756.407998:0:6647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284057856:0@lo:501: 00000100:00100000:2.0:1787829756.408052:0:6647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284057984:0@lo:503: 00000100:00100000:2.0:1787829756.408090:0:6647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829756.408108:0:6647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b75ca4540 going to sleep for 11 seconds 00000100:00100000:3.0:1787829756.408330:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284057984 00000100:00100000:3.0:1787829756.408335:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284057984 00000100:00100000:3.0:1787829756.408367:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787829756.408374:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:6647:x1874675284057984:12345-0@lo:503: 00000100:00100000:3.0:1787829756.408512:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:6647:x1874675284057984:12345-0@lo:503: Request processed in 138us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829756.408519:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787829756.408587:0:6647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284057984:0@lo:503: 00000040:00080000:2.0:1787829756.408852:0:6647:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787829756.408904:0:6647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284058112:0@lo:502: 00000100:00100000:2.0:1787829756.408939:0:6647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829756.408973:0:6647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b75ca4540 going to sleep for 11 seconds 00000100:00100000:3.0:1787829756.409053:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284058112 00000100:00100000:3.0:1787829756.409058:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284058112 00000100:00100000:3.0:1787829756.409084:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787829756.409091:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:6647:x1874675284058112:12345-0@lo:502: 00000100:00100000:3.0:1787829756.409434:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:6647:x1874675284058112:12345-0@lo:502: Request processed in 342us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829756.409441:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787829756.409526:0:6647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284058112:0@lo:502: 00000040:00080000:2.0:1787829756.409785:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787829756.409835:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787829756.409869:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787829756.409915:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787829756.409950:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787829756.410008:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787829756.410367:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787829756.410402:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787829756.410450:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787829756.410484:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787829756.410520:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787829756.410570:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787829756.410609:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787829756.410657:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787829756.410708:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787829756.410745:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787829756.410780:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787829756.410829:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787829756.410866:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787829756.410900:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787829756.410947:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787829756.410984:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787829756.411053:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787829756.411106:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787829756.411144:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787829756.411486:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787829756.411539:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787829756.411576:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1787829756.411619:0:6647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284058240:0@lo:502: 00000100:00100000:2.0:1787829756.411705:0:6647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829756.411750:0:6647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b75ca4540 going to sleep for 11 seconds 00000100:00100000:0.0:1787829756.411867:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284058240 00000100:00100000:0.0:1787829756.411873:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284058240 00000100:00100000:0.0:1787829756.411928:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787829756.411937:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:6647:x1874675284058240:12345-0@lo:502: 00000100:00100000:0.0:1787829756.412185:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:6647:x1874675284058240:12345-0@lo:502: Request processed in 246us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829756.412193:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787829756.412449:0:6647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284058240:0@lo:502: 00000040:00080000:1.0:1787829756.412529:0:6647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787829756.412541:0:6647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1787829756.413091:0:6670:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787829756.413106:0:6670:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9e9b5205cd28) 00000020:00000080:1.0:1787829756.413125:0:6670:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1787829756.413220:0:6670:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e9b53977800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787829756.413225:0:6670:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e9b53977800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787829756.413228:0:6670:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e9b53977800 3 00010000:00080000:1.0:1787829756.413380:0:6670:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e9b7f83d000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.151@tcp at head 00010000:00010000:1.0:1787829756.415468:0:6670:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1787829756.415679:0:6670:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787829756.415713:0:6670:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787829756.415725:0:6670:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc03b4d103c0d767a 00000100:00080000:1.0:1787829756.415737:0:6670:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787829756.415742:0:6670:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e9b7f83d000 using connection 192.168.201.151@tcp/0@lo 00000100:00100000:1.0:1787829756.415780:0:6670:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b5955fc00 x1874675284058368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787829756.415856:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1874675284058368:0@lo:38: 00000100:00100000:0.0:1787829756.415930:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787829756.415987:0:6670:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787829756.416186:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284058368 00000100:00100000:2.0:1787829756.416194:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284058368 00000100:00100000:2.0:1787829756.416235:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787829756.416242:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3277:x1874675284058368:12345-0@lo:38: 00010000:00080000:2.0:1787829756.416414:0:5805:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 136 last 0 00000020:00000080:2.0:1787829756.416443:0:5805:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc03b4d103c0d7681 00000004:00100000:2.0:1787829756.416463:0:5805:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787829756.416493:0:5805:0:(import.c:65:import_set_state_nolock()) ffff9e9b7f82b800 : changing import state from RECOVER to FULL 00000040:00080000:3.0:1787829756.416765:0:6670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:2.0:1787829756.417070:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1874675284058368:12345-0@lo:38: Request processed in 826us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829756.417079:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787829756.417242:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787829756.417263:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874675284058496:0@lo:400: 00000100:00100000:1.0:1787829756.417300:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829756.417333:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284058496 00000100:00100000:1.0:1787829756.417337:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284058496 00000100:00100000:1.0:1787829756.417368:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787829756.417376:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1874675284058496:12345-0@lo:400: 00000100:00100000:1.0:1787829756.417413:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1874675284058496:12345-0@lo:400: Request processed in 38us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829756.417421:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787829756.417455:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e9b48ed2940 x1874675284058496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787829772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829756.417466:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874675284058496:0@lo:400: 00000020:01000000:1.0:1787829756.419296:0:6647:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1787829756.419329:0:6647:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787829756.419350:0:6647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7665 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d766c expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829756.419362:0:6647:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7665 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d766c expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787829756.419428:0:6647:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787829756.419431:0:6647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787829756.419432:0:6647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787829756.419433:0:6647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787829756.419435:0:6647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787829756.419436:0:6647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787829756.419437:0:6647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787829756.419439:0:6647:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787829756.419440:0:6647:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787829756.419442:0:6647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787829756.419443:0:6647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787829756.419448:0:6647:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1787829756.419450:0:6647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787829756.419451:0:6647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787829756.419452:0:6647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787829756.419453:0:6647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787829756.419454:0:6647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787829756.419455:0:6647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787829756.419456:0:6647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787829756.419457:0:6647:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787829756.419458:0:6647:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787829756.419459:0:6647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787829756.419460:0:6647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787829756.419482:0:6647:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787829756.419501:0:6647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284058624:0@lo:253: 00000100:00100000:1.0:1787829756.419560:0:6647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829756.419595:0:6647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fa50000 going to sleep for 11 seconds 00000100:00100000:2.0:1787829756.419923:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284058624 00000100:00100000:2.0:1787829756.419930:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284058624 00000100:00100000:2.0:1787829756.419984:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787829756.419994:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:6647:x1874675284058624:12345-0@lo:253: 20000000:01000000:2.0:1787829756.420042:0:5798:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787829756.420056:0:5798:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1787829756.424733:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e9b5955fc00 x1874675284058368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787829766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829756.424749:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787829756.424761:0:3277:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787829756.424770:0:3277:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787829756.424775:0:3277:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787829756.424779:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9e9b7f83d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787829756.424785:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1874675284058368:0@lo:38: 20000000:01000000:3.0:1787829756.450572:0:5798:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787829756.450594:0:5798:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787829756.451823:0:5820:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787829756.451831:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787829756.451856:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e9b4164e800/0xc03b4d103c0d7688 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829756.451874:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b40031400/0xc03b4d103c0d75e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d75d9 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829756.451883:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e9b4164e800/0xc03b4d103c0d7688 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829756.451923:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b40031400/0xc03b4d103c0d75e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d75d9 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829756.451937:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e9b40031400/0xc03b4d103c0d75e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d75d9 expref: 13 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829756.451950:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed3c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5820:1874675284058752:0@lo:104: 00000100:00100000:2.0:1787829756.452038:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829756.452105:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b60380f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787829756.452387:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284058752 00000100:00100000:3.0:1787829756.452395:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284058752 00000100:00100000:3.0:1787829756.452440:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787829756.452449:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ed21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:5820:x1874675284058752:12345-0@lo:104: 00010000:00010000:3.0:1787829756.452462:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda800/0xc03b4d103c0d75d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d75e0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829756.452518:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787829756.452523:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ed21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:5820:x1874675284058752:12345-0@lo:104: Request processed in 77us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829756.452537:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787829756.452580:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed3c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5820:1874675284058752:0@lo:104: 00010000:00010000:3.0:1787829756.452597:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e9b4164e800/0xc03b4d103c0d7688 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829756.452887:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787829756.452894:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda800/0xc03b4d103c0d75d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d75e0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829756.452902:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b48cda800 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:0.0:1787829756.452906:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda800/0xc03b4d103c0d75d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d75e0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829756.452914:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda800/0xc03b4d103c0d75d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d75e0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787829756.452922:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda800/0xc03b4d103c0d75d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d75e0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787829756.452927:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787829756.452964:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda800/0xc03b4d103c0d75d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d75e0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829756.452972:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787829756.452996:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda800/0xc03b4d103c0d75d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d75e0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829756.453004:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda800/0xc03b4d103c0d75d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d75e0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829756.453041:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829756.453043:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829756.453045:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829756.453053:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787829756.453067:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284058880:0@lo:103: 00000100:00100000:0.0:1787829756.453102:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829756.453131:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284058880 00000100:00100000:0.0:1787829756.453135:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284058880 00010000:00010000:0.0:1787829756.453153:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b40031400/0xc03b4d103c0d75e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d75d9 expref: 14 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829756.453402:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787829756.453410:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b51a06050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:3278:x1874675284058880:12345-0@lo:103: 00010000:00010000:0.0:1787829756.453422:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829756.453427:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b40031400/0xc03b4d103c0d75e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d75d9 expref: 14 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829756.453436:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b40031400/0xc03b4d103c0d75e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d75d9 expref: 14 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829756.453449:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b40031400/0xc03b4d103c0d75e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d75d9 expref: 14 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829756.453461:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e9b4164e800/0xc03b4d103c0d7688 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829756.453475:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b4164e800/0xc03b4d103c0d7688 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787829756.453489:0:5790:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001659064s 00010000:00010000:0.0:1787829756.453493:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b4164e800/0xc03b4d103c0d7688 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829756.453499:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b4164e800/0xc03b4d103c0d7688 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829756.453505:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e9b4164e800/0xc03b4d103c0d7688 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829756.453510:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e9b4164e800/0xc03b4d103c0d7688 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829756.453515:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164e800 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787829756.453518:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e9b4164e800/0xc03b4d103c0d7688 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829756.453525:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e9b4164e800/0xc03b4d103c0d7688 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829756.457428:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:6647:x1874675284058624:12345-0@lo:253: Request processed in 37427us (37858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829756.457442:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1787829756.457516:0:5820:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e9b4164e800/0xc03b4d103c0d7688 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829756.457527:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e9b4164e800/0xc03b4d103c0d7688 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829756.457632:0:6647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6647:1874675284058624:0@lo:253: 10000000:01000000:3.0:1787829756.457648:0:6647:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787829756.457651:0:6647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787829756.457653:0:6647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787829756.457654:0:6647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787829756.457655:0:6647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787829756.457657:0:6647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787829756.457658:0:6647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787829756.457659:0:6647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787829756.457660:0:6647:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787829756.457661:0:6647:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787829756.457663:0:6647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787829756.457664:0:6647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787829756.457680:0:6647:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1787829756.458367:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e9b4164e800/0xc03b4d103c0d7688 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829756.458380:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b4164e800/0xc03b4d103c0d7688 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829756.458402:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829756.458455:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b51a06050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:3278:x1874675284058880:12345-0@lo:103: Request processed in 5046us (5352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829756.458474:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787829756.458592:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284058880:0@lo:103: 00080000:10000000:3.0:1787829756.462231:0:6647:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787829756.462540:0:6647:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787829756.462765:0:6647:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787829756.462944:0:6647:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787829756.463585:0:6647:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787829756.463820:0:6647:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787829756.465012:0:6647:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1787829756.581992:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787829756.615688:0:6647:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787829756.615695:0:6647:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787829756.615726:0:6647:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787829756.615777:0:6647:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.151@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787829756.615790:0:6647:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787829756.615812:0:6647:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787829757.602169:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787829758.434596:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787829758.434604:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e9b51a3b000 from 21 10000000:01000000:2.0:1787829758.434609:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787829758.434657:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d768f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829758.434668:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d768f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829758.434678:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d768f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829758.434701:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284059008:0@lo:101: 00000100:00100000:2.0:1787829758.434771:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829758.434911:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51011cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787829758.435735:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284059008 00000100:00100000:3.0:1787829758.435744:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284059008 00000100:00100000:3.0:1787829758.435853:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787829758.435865:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:5802:x1874675284059008:12345-0@lo:101: 00010000:00010000:3.0:1787829758.435879:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829758.435893:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b596cae00/0xc03b4d103c0d7696 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d768f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829758.435935:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b596cae00/0xc03b4d103c0d7696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d768f expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829758.435944:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b596cae00/0xc03b4d103c0d7696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d768f expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829758.435952:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b596cae00, rc 0) 00000100:00100000:3.0:1787829758.436010:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:5802:x1874675284059008:12345-0@lo:101: Request processed in 146us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829758.436032:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787829758.436113:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284059008:0@lo:101: 00010000:00010000:2.0:1787829758.436143:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d768f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7696 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829758.436160:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d768f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d7696 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829758.436213:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284059136:0@lo:501: 00000100:00100000:2.0:1787829758.436265:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829758.436731:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51011cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787829758.436817:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284059136 00000100:00100000:1.0:1787829758.436875:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284059136 00000100:00100000:1.0:1787829758.436899:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787829758.436905:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:5802:x1874675284059136:12345-0@lo:501: 00000100:00100000:1.0:1787829758.437603:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:5802:x1874675284059136:12345-0@lo:501: Request processed in 696us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829758.437612:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787829758.437928:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284059136:0@lo:501: 00000100:00100000:2.0:1787829758.437965:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284059264:0@lo:503: 00000100:00100000:2.0:1787829758.438008:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829758.438711:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51011cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787829758.439175:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284059264 00000100:00100000:3.0:1787829758.439181:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284059264 00000100:00100000:1.0:1787829758.439568:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787829758.439579:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:5802:x1874675284059264:12345-0@lo:503: 00000100:00100000:1.0:1787829758.440453:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:5802:x1874675284059264:12345-0@lo:503: Request processed in 874us (2442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829758.440462:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787829758.440671:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284059264:0@lo:503: 00000100:00100000:2.0:1787829758.441168:0:6742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed30c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6742:1874675284059392:0@lo:502: 00000100:00100000:2.0:1787829758.441247:0:6742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829758.441848:0:6742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51011000 going to sleep for 11 seconds 00000100:00100000:0.0:1787829758.441982:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284059392 00000100:00100000:0.0:1787829758.441988:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284059392 00000100:00100000:0.0:1787829758.442033:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787829758.442043:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:6742:x1874675284059392:12345-0@lo:502: 00000100:00100000:0.0:1787829758.442454:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:6742:x1874675284059392:12345-0@lo:502: Request processed in 413us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829758.442461:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787829758.442554:0:6742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed30c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6742:1874675284059392:0@lo:502: 00000100:00100000:2.0:1787829758.442607:0:6742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed30c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6742:1874675284059520:0@lo:502: 00000100:00100000:2.0:1787829758.442641:0:6742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829758.442669:0:6742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51011000 going to sleep for 11 seconds 00000100:00100000:0.0:1787829758.442720:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284059520 00000100:00100000:0.0:1787829758.442724:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284059520 00000100:00100000:0.0:1787829758.442742:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787829758.442747:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:6742:x1874675284059520:12345-0@lo:502: 00000100:00100000:0.0:1787829758.442886:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:6742:x1874675284059520:12345-0@lo:502: Request processed in 138us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829758.442893:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787829758.444315:0:6742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed30c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6742:1874675284059520:0@lo:502: 00000040:00080000:2.0:1787829758.444347:0:6742:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1787829758.444633:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1787829758.444651:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787829758.444661:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d768f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7696 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829758.444672:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d768f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7696 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787829758.444695:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787829758.444697:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e9b51a3b000 from 4 10000000:01000000:0.0:1787829758.444700:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787829758.444730:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b40030400/0xc03b4d103c0d769d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829758.444738:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b40030400/0xc03b4d103c0d769d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829758.444747:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b40030400/0xc03b4d103c0d769d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829758.444763:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284059648:0@lo:101: 00000100:00100000:0.0:1787829758.444809:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829758.444979:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4fa6c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787829758.445077:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284059648 00000100:00100000:2.0:1787829758.445083:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284059648 00000100:00100000:2.0:1787829758.445113:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787829758.445121:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:5802:x1874675284059648:12345-0@lo:101: 00010000:00010000:2.0:1787829758.445143:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829758.445161:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b4164e600/0xc03b4d103c0d76a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d769d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829758.445182:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b4164e600/0xc03b4d103c0d76a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d769d expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829758.445199:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b4164e600/0xc03b4d103c0d76a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d769d expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829758.445206:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164e600, rc 0) 00000100:00100000:2.0:1787829758.445404:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:5802:x1874675284059648:12345-0@lo:101: Request processed in 282us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829758.445411:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787829758.445502:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284059648:0@lo:101: 00010000:00010000:0.0:1787829758.445514:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b40030400/0xc03b4d103c0d769d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d76a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829758.445522:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b40030400/0xc03b4d103c0d769d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d76a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829758.445566:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284059776:0@lo:256: 00000100:00100000:0.0:1787829758.445605:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829758.445632:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4fa6c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787829758.445688:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284059776 00000100:00100000:2.0:1787829758.445692:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284059776 00000100:00100000:2.0:1787829758.445713:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787829758.445720:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:5802:x1874675284059776:12345-0@lo:256: 20000000:01000000:2.0:1787829758.445734:0:5798:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787829758.445748:0:5798:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787829758.445751:0:5798:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787829758.445904:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:5802:x1874675284059776:12345-0@lo:256: Request processed in 184us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829758.445911:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787829758.446045:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284059776:0@lo:256: 10000000:01000000:0.0:1787829758.446084:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787829758.446093:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b40030400/0xc03b4d103c0d769d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d76a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829758.446101:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b40030400/0xc03b4d103c0d769d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d76a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787829758.446107:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787829758.446109:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1787829758.446111:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787829758.446138:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d76ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829758.446144:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d76ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829758.446151:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d76ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829758.446162:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284059904:0@lo:101: 00000100:00100000:0.0:1787829758.446185:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829758.446201:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4fa6c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787829758.446412:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284059904 00000100:00100000:2.0:1787829758.446416:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284059904 00000100:00100000:2.0:1787829758.446434:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787829758.446440:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:5802:x1874675284059904:12345-0@lo:101: 00010000:00010000:2.0:1787829758.446447:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829758.446456:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b4164fc00/0xc03b4d103c0d76b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d76ab expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829758.446472:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b4164fc00/0xc03b4d103c0d76b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d76ab expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829758.446490:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b4164fc00/0xc03b4d103c0d76b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d76ab expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829758.446496:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164fc00, rc 0) 00000100:00100000:2.0:1787829758.446530:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:5802:x1874675284059904:12345-0@lo:101: Request processed in 90us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829758.446536:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787829758.446608:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284059904:0@lo:101: 00010000:00010000:0.0:1787829758.446618:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d76ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d76b2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829758.446625:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d76ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d76b2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829758.446668:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284060032:0@lo:501: 00000100:00100000:0.0:1787829758.446699:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829758.446724:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4fa6c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787829758.446766:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284060032 00000100:00100000:2.0:1787829758.446769:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284060032 00000100:00100000:2.0:1787829758.446786:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787829758.446792:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69c97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:5802:x1874675284060032:12345-0@lo:501: 00000100:00100000:2.0:1787829758.447136:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69c97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:5802:x1874675284060032:12345-0@lo:501: Request processed in 333us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829758.447143:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787829758.447418:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284060032:0@lo:501: 00000100:00100000:0.0:1787829758.447446:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284060160:0@lo:503: 00000100:00100000:0.0:1787829758.447480:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829758.447508:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4fa6c480 going to sleep for 11 seconds 00000100:00100000:3.0:1787829758.447582:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284060160 00000100:00100000:3.0:1787829758.447595:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284060160 00000100:00100000:3.0:1787829758.447620:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787829758.447627:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69c95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:5802:x1874675284060160:12345-0@lo:503: 00000100:00100000:3.0:1787829758.447819:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69c95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:5802:x1874675284060160:12345-0@lo:503: Request processed in 192us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829758.447898:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787829758.447974:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284060160:0@lo:503: 00000100:00100000:2.0:1787829758.448576:0:6743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed30c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6743:1874675284060288:0@lo:502: 00000100:00100000:2.0:1787829758.448622:0:6743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829758.448651:0:6743:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51011600 going to sleep for 11 seconds 00000100:00100000:3.0:1787829758.448693:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284060288 00000100:00100000:3.0:1787829758.448697:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284060288 00000100:00100000:3.0:1787829758.448726:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787829758.448732:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:6743:x1874675284060288:12345-0@lo:502: 00000100:00100000:3.0:1787829758.449083:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:6743:x1874675284060288:12345-0@lo:502: Request processed in 350us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829758.449090:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787829758.449428:0:6743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed30c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6743:1874675284060288:0@lo:502: 00000020:01000000:0.0:1787829758.449454:0:6743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787829758.449462:0:6743:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787829758.449469:0:6743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787829758.449472:0:6743:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787829758.449478:0:6743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787829758.449482:0:6743:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.151@tcp to nid 0x20000c0a8c997 (192.168.201.151@tcp) 00000020:01000000:0.0:1787829758.449503:0:6743:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787829758.449506:0:6743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787829758.449520:0:6743:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e9b69c2b370) 00000020:00000080:0.0:1787829758.449538:0:6743:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1787829758.449545:0:6743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787829758.449632:0:6743:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787829758.449638:0:6743:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787829758.449646:0:6743:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc03b4d103c0d76c0 00010000:00080000:0.0:1787829758.449674:0:6743:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e9b81f08000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.151@tcp at head 00010000:00010000:0.0:1787829758.449968:0:6743:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1787829758.529237:0:6743:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787829758.529277:0:6743:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787829758.530352:0:6743:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787829758.530522:0:6743:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787829758.530567:0:6743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1787829758.530633:0:6743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787829758.534617:0:6745:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787829758.534623:0:6745:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787829758.535401:0:6743:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787829758.535415:0:6743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787829758.535449:0:6743:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787829758.535485:0:6743:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc03b4d103c0d76c7 00000100:00080000:1.0:1787829758.535498:0:6743:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787829758.535504:0:6743:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e9b81f08000 using connection 192.168.201.151@tcp/0@lo 00000100:00100000:1.0:1787829758.535542:0:6743:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b5955e580 x1874675284060416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787829758.535574:0:6743:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787829758.535672:0:6743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787829758.535677:0:6743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787829758.535680:0:6743:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787829758.535684:0:6743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787829758.535688:0:6743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787829758.535690:0:6743:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787829758.535693:0:6743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787829758.535696:0:6743:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787829758.535698:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b59693c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874675284060544:0@lo:400: 00000100:00100000:1.0:1787829758.535736:0:6743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6743:1874675284060800:0@lo:502: 00000100:00100000:3.0:1787829758.535767:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829758.535791:0:6743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829758.535821:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787829758.535825:0:6743:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b5870c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787829758.535831:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b596921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284060672:0@lo:400: 00000100:00100000:1.0:1787829758.535850:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284060800 00000100:00100000:1.0:1787829758.535858:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284060800 00000100:00100000:3.0:1787829758.535863:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829758.535904:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787829758.535914:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69c95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:6743:x1874675284060800:12345-0@lo:502: 00000100:00100000:1.0:1787829758.536177:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69c95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:6743:x1874675284060800:12345-0@lo:502: Request processed in 263us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829758.536186:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787829758.536229:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284060544 00000100:00100000:1.0:1787829758.536233:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284060544 00000100:00100000:1.0:1787829758.536259:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284060672 00000100:00100000:1.0:1787829758.536262:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284060672 00000100:00100000:1.0:1787829758.536287:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787829758.536294:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b59692580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874675284060544:12345-0@lo:400: 00000100:00100000:1.0:1787829758.536340:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b59692580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874675284060544:12345-0@lo:400: Request processed in 47us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829758.536347:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787829758.536361:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787829758.536368:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b596912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284060672:12345-0@lo:400: 00000100:00100000:1.0:1787829758.536397:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b596912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284060672:12345-0@lo:400: Request processed in 31us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829758.536403:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787829758.536423:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787829758.536453:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b596921c0 x1874675284060672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787829774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829758.536467:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b596921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284060672:0@lo:400: 00010000:00080000:1.0:1787829758.536480:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b59693c00 x1874675284060544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787829774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829758.536488:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b59693c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874675284060544:0@lo:400: 00000100:00100000:3.0:1787829758.536662:0:6743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:6743:1874675284060800:0@lo:502: 00000020:01000000:3.0:1787829758.536687:0:6743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787829758.536693:0:6743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787829758.536695:0:6743:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787829758.536699:0:6743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:2.0:1787829758.536845:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1874675284060416:0@lo:8: 00000100:00100000:2.0:1787829758.536883:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829758.536953:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284060416 00000100:00100000:3.0:1787829758.536958:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284060416 00000100:00100000:3.0:1787829758.536992:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787829758.536996:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ed0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3277:x1874675284060416:12345-0@lo:8: 00010000:00080000:3.0:1787829758.537034:0:6650:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 138 last 0 00000020:01000000:1.0:1787829758.537046:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 00000020:00000080:3.0:1787829758.537061:0:6650:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc03b4d103c0d76ce 10000000:01000000:1.0:1787829758.537068:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787829758.537079:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d76ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d76b2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829758.537093:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d76ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d76b2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1787829758.537099:0:6650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e9b7f522800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113940 ocd_grant: 0 ocd_index: 0 ocd_group 0 10000000:01000000:1.0:1787829758.537104:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 00002000:00080000:3.0:1787829758.537105:0:6650:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 10000000:01000000:1.0:1787829758.537109:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e9b4f8419b8 from 1 00000001:00000004:3.0:1787829758.537112:0:6650:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 10000000:01000000:1.0:1787829758.537114:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787829758.537228:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb200/0xc03b4d103c0d76d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829758.537239:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb200/0xc03b4d103c0d76d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829758.537249:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb200/0xc03b4d103c0d76d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1787829758.537252:0:6650:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1787829758.537268:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284060928:0@lo:101: 00000100:00100000:1.0:1787829758.537304:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829758.537327:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b5870c180 going to sleep for 11 seconds 00000100:00100000:1.0:1787829758.537348:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284060928 00000100:00100000:1.0:1787829758.537353:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284060928 00000100:00100000:1.0:1787829758.537385:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787829758.537395:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:5802:x1874675284060928:12345-0@lo:101: 00010000:00010000:1.0:1787829758.537407:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829758.537422:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d76dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d76d5 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1787829758.537440:0:6650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00010000:00010000:1.0:1787829758.537448:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d76dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d76d5 expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829758.537461:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d76dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d76d5 expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829758.537470:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b48cdac00, rc 0) 00000100:00080000:3.0:1787829758.537472:0:6650:0:(import.c:65:import_set_state_nolock()) ffff9e9b7f521000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787829758.537509:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:5802:x1874675284060928:12345-0@lo:101: Request processed in 116us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829758.537517:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787829758.537527:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ed0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3277:x1874675284060416:12345-0@lo:8: Request processed in 526us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829758.537536:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787829758.537568:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284060928:0@lo:101: 00010000:00010000:1.0:1787829758.537580:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb200/0xc03b4d103c0d76d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d76dc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829758.538639:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb200/0xc03b4d103c0d76d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d76dc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829758.538726:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284061056:0@lo:501: 00010000:00080000:2.0:1787829758.538755:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b5955e580 x1874675284060416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787829768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829758.538766:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787829758.538775:0:3277:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00100000:1.0:1787829758.538775:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787829758.538786:0:3277:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787829758.538794:0:3277:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787829758.538809:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9e9b81f08000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787829758.538819:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b5870c180 going to sleep for 11 seconds 00000004:00080000:2.0:1787829758.538828:0:3277:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787829758.538836:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1874675284060416:0@lo:8: 00000100:00100000:1.0:1787829758.538841:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284061056 00000100:00100000:1.0:1787829758.538846:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284061056 00000100:00100000:1.0:1787829758.538877:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787829758.538886:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:5802:x1874675284061056:12345-0@lo:501: 00000100:00100000:1.0:1787829758.539154:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:5802:x1874675284061056:12345-0@lo:501: Request processed in 270us (380us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787829758.539168:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000004:00080000:2.0:1787829758.539632:0:6745:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787829758.539759:0:6745:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 138440741230ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787829758.541898:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284061056:0@lo:501: 10000000:01000000:1.0:1787829758.541950:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787829758.541962:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb200/0xc03b4d103c0d76d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d76dc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829758.541973:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb200/0xc03b4d103c0d76d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d76dc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829758.635601:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787829758.663120:0:6746:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787829758.663157:0:6746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b59690f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6746:1874675284061312:0@lo:7: 00000100:00100000:3.0:1787829758.663330:0:6746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829758.663384:0:6746:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b42cb3600 going to sleep for 11 seconds 00000100:00100000:3.0:1787829758.663410:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284061312 00000100:00100000:3.0:1787829758.663417:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284061312 00000100:00100000:3.0:1787829758.663468:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787829758.663476:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b596903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6746:x1874675284061312:12345-0@lo:7: 00000100:00100000:1.0:1787829758.663873:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b59690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284061184:0@lo:13: 00000100:00100000:1.0:1787829758.663911:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787829758.663955:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787829758.663971:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284061184 00000100:00100000:1.0:1787829758.663975:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284061184 00000100:00100000:1.0:1787829758.663998:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787829758.664004:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3278:x1874675284061184:12345-0@lo:13: 00002000:00000024:1.0:1787829758.664041:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787829758.664084:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3278:x1874675284061184:12345-0@lo:13: Request processed in 79us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829758.664090:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787829758.664129:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b59690000 x1874675284061184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829774 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829758.664150:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b59690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284061184:0@lo:13: 00002000:00080000:3.0:1787829758.683491:0:6652:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1787829758.683499:0:6652:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787829758.683606:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b596903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6746:x1874675284061312:12345-0@lo:7: Request processed in 20126us (20273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829758.683618:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787829758.685569:0:6746:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b59690f00 x1874675284061312/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787829774 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829758.685601:0:6746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b59690f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6746:1874675284061312:0@lo:7: 00000004:00080000:2.0:1787829758.685617:0:6746:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787829758.685671:0:6746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed3c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6746:1874675284061440:0@lo:5: 00000100:00100000:2.0:1787829758.685729:0:6746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829758.685795:0:6746:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b510116c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787829758.687391:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284061440 00000100:00100000:3.0:1787829758.687402:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284061440 00000100:00100000:3.0:1787829758.689714:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787829758.689733:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ed2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6746:x1874675284061440:12345-0@lo:5: 00002000:00080000:3.0:1787829758.689768:0:6651:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787829758.689773:0:6651:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787829758.690221:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ed2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6746:x1874675284061440:12345-0@lo:5: Request processed in 494us (4490us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787829758.690231:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787829758.690266:0:6746:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b48ed3c00 x1874675284061440/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787829774 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829758.690285:0:6746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed3c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6746:1874675284061440:0@lo:5: 00000004:00080000:2.0:1787829758.690299:0:6746:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787829758.690333:0:6746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed3840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6746:1874675284061568:0@lo:700: 00000100:00100000:2.0:1787829758.690369:0:6746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829758.690402:0:6746:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b510116c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787829758.691915:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284061568 00000100:00100000:0.0:1787829758.691925:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284061568 00000100:00100000:0.0:1787829758.691975:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787829758.691985:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ed03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6746:x1874675284061568:12345-0@lo:700: 00000100:00100000:0.0:1787829758.692078:0:6658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6658:1874675284061696:0@lo:700: 00000100:00100000:0.0:1787829758.692159:0:6658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829758.692185:0:6658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b60325f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787829758.692207:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284061696 00000100:00100000:0.0:1787829758.692210:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284061696 00000100:00100000:0.0:1787829758.692240:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787829758.692246:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6658:x1874675284061696:12345-0@lo:700: 00000004:00080000:0.0:1787829758.732298:0:5827:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:3.0:1787829758.785035:0:5811:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1787829758.789861:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6658:x1874675284061696:12345-0@lo:700: Request processed in 97607us (97694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829758.789895:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787829758.790010:0:6658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b48ebc780 x1874675284061696/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787829774 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829758.790048:0:6658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6658:1874675284061696:0@lo:700: 40000000:02000000:0.0:1787829758.790179:0:6658:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:3.0:1787829758.912631:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1787829758.912649:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787829758.913304:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ed03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6746:x1874675284061568:12345-0@lo:700: Request processed in 221314us (222927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829758.913322:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787829758.913993:0:6746:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b48ed3840 x1874675284061568/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787829774 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829758.914010:0:6746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed3840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6746:1874675284061568:0@lo:700: 00000004:02000040:0.0:1787829758.986103:0:6746:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1787829758.989224:0:6746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6746:1874675284061824:0@lo:5: 00000100:00100000:0.0:1787829758.989296:0:6746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829758.989353:0:6746:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fb653c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787829758.989538:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284061824 00000100:00100000:1.0:1787829758.989548:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284061824 00000100:00100000:1.0:1787829758.989626:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787829758.989636:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6746:x1874675284061824:12345-0@lo:5: 00002000:00080000:2.0:1787829758.997631:0:6652:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787829758.997653:0:6652:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1787829759.013303:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6746:x1874675284061824:12345-0@lo:5: Request processed in 23661us (23998us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787829759.013318:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787829759.016440:0:6746:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b48ebc780 x1874675284061824/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787829774 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829759.016457:0:6746:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787829759.016473:0:6746:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9e9b48ebc780 x1874675284061824/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787829774 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829759.016485:0:6746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6746:1874675284061824:0@lo:5: 00000004:00080000:0.0:1787829759.016499:0:6746:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1787829759.653157:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829760.677174:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829761.699101:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829762.722302:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787829763.119998:0:7017:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg151-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787829763.747564:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787829763.940871:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284061952:0@lo:400: 00000100:00100000:2.0:1787829763.940943:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829763.940995:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787829763.941000:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284062336:0@lo:400: 00000100:00100000:2.0:1787829763.941046:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829763.941092:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874675284062080:0@lo:400: 00000100:00100000:2.0:1787829763.941120:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829763.941139:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787829763.941145:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284062208:0@lo:400: 00000100:00100000:2.0:1787829763.941169:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829763.941210:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284061952 00000100:00100000:2.0:1787829763.941217:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284061952 00000100:00100000:2.0:1787829763.941263:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787829763.941271:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:3279:x1874675284061952:12345-0@lo:400: 00000100:00100000:2.0:1787829763.941322:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:3279:x1874675284061952:12345-0@lo:400: Request processed in 52us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829763.941329:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787829763.941366:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284062336 00000100:00100000:2.0:1787829763.941370:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284062336 00000100:00100000:2.0:1787829763.941407:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787829763.941413:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ed1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3279:x1874675284062336:12345-0@lo:400: 00000100:00100000:2.0:1787829763.941457:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ed1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3279:x1874675284062336:12345-0@lo:400: Request processed in 44us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829763.941463:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787829763.941484:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284062080 00000100:00100000:2.0:1787829763.941487:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284062080 00000100:00100000:2.0:1787829763.941534:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284062208 00000100:00100000:2.0:1787829763.941537:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284062208 00000100:00100000:2.0:1787829763.941552:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787829763.941557:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ed3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874675284062080:12345-0@lo:400: 00000100:00100000:2.0:1787829763.941592:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ed3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874675284062080:12345-0@lo:400: Request processed in 34us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829763.941598:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787829763.941610:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787829763.941617:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ed3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284062208:12345-0@lo:400: 00000100:00100000:2.0:1787829763.942772:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ed3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284062208:12345-0@lo:400: Request processed in 1151us (1597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829763.942781:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787829763.942838:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b48ed0f00 x1874675284062336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829763.942853:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284062336:0@lo:400: 00000100:00100000:2.0:1787829763.942865:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284061952:0@lo:400: 00000100:00080000:2.0:1787829763.942897:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787829763.942901:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787829763.942926:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b48ed3480 x1874675284062208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787829779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829763.942934:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284062208:0@lo:400: 00010000:00080000:2.0:1787829763.942944:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b48ed2580 x1874675284062080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787829779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829763.942951:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874675284062080:0@lo:400: 00000100:00100000:2.0:1787829763.950106:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284062464:0@lo:13: 00000100:00100000:2.0:1787829763.950184:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829763.950279:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284062464 00000100:00100000:2.0:1787829763.950287:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284062464 00000100:00100000:2.0:1787829763.950329:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787829763.950337:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ed2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1874675284062464:12345-0@lo:13: 00002000:00000024:2.0:1787829763.950370:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787829763.950412:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ed2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1874675284062464:12345-0@lo:13: Request processed in 75us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829763.950420:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787829763.950718:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b48ebde00 x1874675284062464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829763.950738:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284062464:0@lo:13: 00000001:00080000:2.0:1787829764.073767:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1787829764.774442:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829765.794315:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829766.818201:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829767.844733:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829768.868190:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829769.059190:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284062592:0@lo:13: 00000100:00100000:1.0:1787829769.059274:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829769.059432:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284062592 00000100:00100000:1.0:1787829769.059439:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284062592 00000100:00100000:1.0:1787829769.059491:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787829769.059501:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284062592:12345-0@lo:13: 00002000:00000024:1.0:1787829769.059534:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787829769.059581:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284062592:12345-0@lo:13: Request processed in 81us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829769.059588:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787829769.059612:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284062848:0@lo:400: 00000100:00100000:1.0:1787829769.059638:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829769.059665:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787829769.059672:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284062976:0@lo:400: 00000100:00100000:1.0:1787829769.059693:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787829769.059721:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787829769.059904:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284062848 00000100:00100000:2.0:1787829769.059909:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284062848 00000100:00100000:2.0:1787829769.059938:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284062976 00000100:00100000:2.0:1787829769.059941:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284062976 00000100:00100000:2.0:1787829769.059962:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787829769.059969:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284062848:12345-0@lo:400: 00000100:00100000:1.0:1787829769.060164:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787829769.060173:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787829769.060259:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3281:1874675284062720:0@lo:400: 00000100:00100000:1.0:1787829769.060293:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787829769.060334:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787829769.060351:0:5805:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787829769.060361:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787829769.060368:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284062976:12345-0@lo:400: 00000100:00100000:2.0:1787829769.060418:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284062976:12345-0@lo:400: Request processed in 51us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829769.060425:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787829769.060454:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b7fa461c0 x1874675284062976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787829785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829769.060480:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284062976:0@lo:400: 00010000:00080000:1.0:1787829769.060485:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b5955e580 x1874675284062592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829769.060494:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787829769.060511:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284062592:0@lo:13: 00000100:00100000:2.0:1787829769.060521:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284062848:12345-0@lo:400: Request processed in 553us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829769.060527:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787829769.060772:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284062720 00000100:00100000:0.0:1787829769.060777:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284062720 00000100:00100000:0.0:1787829769.060805:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787829769.060813:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:3281:x1874675284062720:12345-0@lo:400: 00000100:00100000:0.0:1787829769.060852:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:3281:x1874675284062720:12345-0@lo:400: Request processed in 40us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829769.060858:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787829769.060892:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3281:1874675284062720:0@lo:400: 00010000:00080000:2.0:1787829769.063276:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b5955f840 x1874675284062848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787829785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829769.063296:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284062848:0@lo:400: 00010000:00010000:1.0:1787829769.894472:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829770.918891:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829771.949486:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829772.964252:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829773.991934:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829774.178892:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284063104:0@lo:13: 00000100:00100000:1.0:1787829774.178962:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829774.179810:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284063104 00000100:00100000:2.0:1787829774.179820:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284063104 00000100:00100000:2.0:1787829774.179896:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787829774.179919:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa44780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284063104:12345-0@lo:13: 00002000:00000024:2.0:1787829774.179952:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787829774.180297:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787829774.180738:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa44780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284063104:12345-0@lo:13: Request processed in 832us (1775us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829774.180745:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787829774.180781:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284063360:0@lo:400: 00000100:00100000:2.0:1787829774.180815:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829774.180852:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787829774.180859:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284063488:0@lo:400: 00000100:00100000:2.0:1787829774.180905:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829774.180939:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284063360 00000100:00100000:2.0:1787829774.180944:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284063360 00000100:00100000:2.0:1787829774.180978:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284063488 00000100:00100000:2.0:1787829774.180981:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284063488 00000100:00100000:2.0:1787829774.181002:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787829774.181008:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ed2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284063360:12345-0@lo:400: 00000100:00100000:2.0:1787829774.181150:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ed2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284063360:12345-0@lo:400: Request processed in 141us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829774.181157:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787829774.181170:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787829774.181176:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f5443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284063488:12345-0@lo:400: 00000100:00100000:2.0:1787829774.181198:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f5443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284063488:12345-0@lo:400: Request processed in 24us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829774.181203:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787829774.181236:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b48ed3480 x1874675284063488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787829790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829774.181249:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284063488:0@lo:400: 00010000:00080000:2.0:1787829774.181258:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b48ed1e00 x1874675284063360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787829790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829774.181266:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284063360:0@lo:400: 00000100:00100000:2.0:1787829774.181290:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3281:1874675284063232:0@lo:400: 00000100:00100000:2.0:1787829774.181325:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829774.181358:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284063232 00000100:00100000:2.0:1787829774.181361:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284063232 00000100:00100000:2.0:1787829774.181381:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787829774.181386:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:3281:x1874675284063232:12345-0@lo:400: 00000100:00100000:2.0:1787829774.181413:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:3281:x1874675284063232:12345-0@lo:400: Request processed in 27us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829774.181419:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1787829774.181438:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787829774.181625:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3281:1874675284063232:0@lo:400: 00010000:00080000:2.0:1787829774.181658:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b7fa46d00 x1874675284063104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829774.181672:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284063104:0@lo:13: 00000020:01000004:3.0:1787829774.452969:0:7586:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787829774.452974:0:7586:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787829774.453151:0:7586:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e9b7f524800 00000020:01000004:3.0:1787829774.453169:0:7586:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787829774.453182:0:7586:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787829774.453197:0:7586:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9e9b7f584d28) 00000020:00000080:3.0:1787829774.453218:0:7586:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787829774.477550:0:7586:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787829774.478339:0:7586:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787829774.508444:0:7586:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787829774.514651:0:7586:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787829774.515499:0:7586:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787829774.515567:0:7586:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787829774.515595:0:7586:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787829774.516465:0:7586:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787829774.516480:0:7586:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787829774.516499:0:7586:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc03b4d103c0d76ea 00000020:01000004:3.0:1787829774.516509:0:7586:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787829774.516530:0:7586:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.151@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787829774.516535:0:7586:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787829774.516540:0:7586:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787829774.516562:0:7586:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787829774.516566:0:7586:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.151@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787829774.544660:0:7586:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.151@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787829774.544923:0:7586:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.151@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787829774.544927:0:7586:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787829774.544929:0:7586:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787829774.544931:0:7586:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787829774.544932:0:7586:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787829774.544934:0:7586:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787829774.544935:0:7586:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787829774.544937:0:7586:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787829774.544938:0:7586:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787829774.544940:0:7586:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787829774.544942:0:7586:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787829774.544943:0:7586:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787829774.545234:0:7586:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787829774.545238:0:7586:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787829774.545239:0:7586:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787829774.545241:0:7586:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787829774.545242:0:7586:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787829774.545243:0:7586:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787829774.545244:0:7586:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787829774.545245:0:7586:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787829774.545246:0:7586:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787829774.545247:0:7586:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787829774.545249:0:7586:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787829774.545250:0:7586:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787829774.545284:0:7586:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787829774.545314:0:7586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f544000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284063616:0@lo:253: 00000100:00100000:2.0:1787829774.545385:0:7586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829774.545440:0:7586:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51e6e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787829774.545521:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284063616 00000100:00100000:0.0:1787829774.545528:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284063616 00000100:00100000:0.0:1787829774.545578:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787829774.545587:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:7586:x1874675284063616:12345-0@lo:253: 20000000:01000000:0.0:1787829774.545613:0:5800:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787829774.545617:0:5800:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1787829774.545622:0:5800:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1787829774.545625:0:5800:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1787829774.547642:0:5800:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787829774.548550:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1787829774.548567:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787829774.548611:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1787829774.548621:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787829774.548651:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1787829774.548803:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1787829774.549589:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787829774.549609:0:5800:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.151@tcp 20000000:01000000:1.0:1787829774.549611:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.151@tcp (null) (null) (null) 00000040:00080000:1.0:1787829774.549649:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787829774.549656:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787829774.549866:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787829774.549876:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.151@tcp (null) (null) 00000040:00080000:1.0:1787829774.549921:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787829774.549931:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787829774.550323:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787829774.550381:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787829774.551418:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1787829774.551438:0:5800:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.151@tcp 20000000:01000000:1.0:1787829774.551441:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.151@tcp (null) (null) (null) 00000040:00080000:1.0:1787829774.551478:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787829774.551485:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787829774.551514:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787829774.551521:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.151@tcp (null) (null) 00000040:00080000:1.0:1787829774.551551:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787829774.551560:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787829774.551606:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787829774.551644:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787829774.551659:0:5800:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1787829774.551662:0:5800:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1787829774.552835:0:5800:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787829774.552839:0:5800:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787829774.552841:0:5800:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787829774.552868:0:5800:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787829774.552871:0:5800:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787829774.552926:0:5800:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787829774.552929:0:5800:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787829774.553742:0:7588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1787829774.554265:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1787829774.554326:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1787829774.554417:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1787829774.554432:0:5800:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787829774.554435:0:5800:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787829774.555594:0:7589:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1787829774.555652:0:7589:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1787829774.555724:0:7589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1787829774.559517:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1787829774.559570:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1787829774.559645:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1787829774.559662:0:5800:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787829774.560322:0:5800:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787829774.561732:0:7590:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1787829774.562328:0:7590:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1787829774.562371:0:7590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1787829774.563226:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1787829774.563280:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1787829774.563357:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1787829774.563372:0:5800:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787829774.563375:0:5800:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787829774.564409:0:7591:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1787829774.564470:0:7591:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1787829774.564526:0:7591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787829774.565333:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1787829774.565392:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1787829774.565444:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:3.0:1787829774.565464:0:5800:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787829774.565484:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e9b596cb800/0xc03b4d103c0d76f1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.565503:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b4164e000/0xc03b4d103c0d7642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d763b expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.565511:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b596cb200/0xc03b4d103c0d766c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7665 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.565524:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b596cae00/0xc03b4d103c0d7696 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d768f expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.565531:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b4164fc00/0xc03b4d103c0d76b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d76ab expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.565538:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d76dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d76d5 expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.565547:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e9b596cb800/0xc03b4d103c0d76f1 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.565588:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d76dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d76d5 expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.565603:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d76dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d76d5 expref: 16 pid: 5799 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829774.565617:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b59692d00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5800:1874675284063744:0@lo:104: 00000100:00100000:3.0:1787829774.566297:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787829774.566416:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b4164fc00/0xc03b4d103c0d76b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d76ab expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.566427:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e9b4164fc00/0xc03b4d103c0d76b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d76ab expref: 16 pid: 5798 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829774.566437:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b59690f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5800:1874675284063872:0@lo:104: 00010000:00010000:3.0:1787829774.566468:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b596cae00/0xc03b4d103c0d7696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d768f expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.566489:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e9b596cae00/0xc03b4d103c0d7696 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d768f expref: 16 pid: 5800 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829774.566499:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b59690000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5800:1874675284064000:0@lo:104: 00010000:00010000:3.0:1787829774.566528:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b596cb200/0xc03b4d103c0d766c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d7665 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.566537:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e9b596cb200/0xc03b4d103c0d766c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d7665 expref: 16 pid: 5800 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829774.566544:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b59693c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5800:1874675284064128:0@lo:104: 00010000:00010000:3.0:1787829774.566566:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b4164e000/0xc03b4d103c0d7642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d763b expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.566575:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e9b4164e000/0xc03b4d103c0d7642 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d763b expref: 16 pid: 5799 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829774.566582:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b596921c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5800:1874675284064256:0@lo:104: 00000100:00100000:3.0:1787829774.566599:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b42cfa840 going to sleep for 11 seconds 00000100:00100000:2.0:1787829774.567481:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787829774.567510:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829774.567558:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829774.567568:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829774.567578:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829774.567591:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284063744 00000100:00100000:2.0:1787829774.567599:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284063744 00000100:00100000:2.0:1787829774.567640:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284063872 00000100:00100000:2.0:1787829774.567643:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284063872 00000100:00100000:2.0:1787829774.567653:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284064000 00000100:00100000:2.0:1787829774.567656:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284064000 00000100:00100000:2.0:1787829774.568145:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284064128 00000100:00100000:2.0:1787829774.568149:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284064128 00000100:00100000:3.0:1787829774.568254:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284064256 00000100:00100000:3.0:1787829774.568259:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284064256 00000100:00100000:3.0:1787829774.568282:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787829774.568291:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52107c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+7:5800:x1874675284063744:12345-0@lo:104: 00010000:00010000:3.0:1787829774.568317:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb200/0xc03b4d103c0d76d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d76dc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.568397:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787829774.568409:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52107c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+7:5800:x1874675284063744:12345-0@lo:104: Request processed in 119us (2114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829774.568417:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787829774.568458:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787829774.568464:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f544f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+6:5800:x1874675284063872:12345-0@lo:104: 00010000:00010000:3.0:1787829774.568472:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d76ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d76b2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.568500:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787829774.568505:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f544f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+6:5800:x1874675284063872:12345-0@lo:104: Request processed in 41us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829774.568510:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787829774.568522:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787829774.568527:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f545680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+5:5800:x1874675284064000:12345-0@lo:104: 00010000:00010000:3.0:1787829774.568535:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d768f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d7696 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.568560:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787829774.568564:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f545680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+5:5800:x1874675284064000:12345-0@lo:104: Request processed in 37us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829774.568569:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787829774.568579:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787829774.568585:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f546940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+4:5800:x1874675284064128:12345-0@lo:104: 00010000:00010000:3.0:1787829774.568592:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7665 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d766c expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.568616:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787829774.568626:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f546940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+4:5800:x1874675284064128:12345-0@lo:104: Request processed in 41us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829774.568632:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787829774.568645:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787829774.568650:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f547840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:5800:x1874675284064256:12345-0@lo:104: 00010000:00010000:3.0:1787829774.568657:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b596cbc00/0xc03b4d103c0d763b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d7642 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.568695:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1787829774.568700:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f547840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:5800:x1874675284064256:12345-0@lo:104: Request processed in 50us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829774.568705:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787829774.568778:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787829774.568792:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb200/0xc03b4d103c0d76d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d76dc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.568799:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b48cdb200 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:0.0:1787829774.568803:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb200/0xc03b4d103c0d76d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d76dc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.568812:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb200/0xc03b4d103c0d76d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d76dc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787829774.568819:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb200/0xc03b4d103c0d76d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d76dc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787829774.568825:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787829774.568873:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb200/0xc03b4d103c0d76d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d76dc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.568880:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787829774.568909:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb200/0xc03b4d103c0d76d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d76dc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.568916:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb200/0xc03b4d103c0d76d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d76dc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.568929:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787829774.568932:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d76ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d76b2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.568938:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40030a00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:0.0:1787829774.568940:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d76ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d76b2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.568967:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d76ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d76b2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787829774.568973:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d76ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d76b2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787829774.568978:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787829774.568991:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d76ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d76b2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.568997:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787829774.569002:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d76ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d76b2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.569008:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d76ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d76b2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.569044:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787829774.569047:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d768f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d7696 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.569053:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164e800 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:0.0:1787829774.569056:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d768f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d7696 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.569062:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d768f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d7696 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787829774.569068:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d768f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d7696 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787829774.569078:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787829774.569092:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d768f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7696 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.569098:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787829774.569110:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d768f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7696 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.569117:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d768f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7696 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.569127:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787829774.569129:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7665 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d766c expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.569135:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164ea00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:0.0:1787829774.569138:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7665 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d766c expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.569144:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d766c expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787829774.569149:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d766c expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787829774.569154:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787829774.569166:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7665 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d766c expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.569172:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787829774.569183:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7665 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d766c expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.569190:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7665 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d766c expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.569199:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787829774.569202:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b596cbc00/0xc03b4d103c0d763b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d7642 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.569208:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b596cbc00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:0.0:1787829774.569211:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b596cbc00/0xc03b4d103c0d763b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d7642 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.569217:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b596cbc00/0xc03b4d103c0d763b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d7642 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787829774.569223:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b596cbc00/0xc03b4d103c0d763b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d7642 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787829774.569229:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787829774.569241:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b596cbc00/0xc03b4d103c0d763b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7642 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.569246:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787829774.569250:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b596cbc00/0xc03b4d103c0d763b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7642 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.569255:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b596cbc00/0xc03b4d103c0d763b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7642 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.569269:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829774.569276:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829774.569278:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829774.569285:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829774.569747:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b59692d00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5800:1874675284063744:0@lo:104: 00000100:00100000:1.0:1787829774.569770:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b59690f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5800:1874675284063872:0@lo:104: 00000100:00100000:1.0:1787829774.569780:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b59690000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5800:1874675284064000:0@lo:104: 00000100:00100000:1.0:1787829774.569788:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b59693c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5800:1874675284064128:0@lo:104: 00000100:00100000:1.0:1787829774.569795:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b596921c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5800:1874675284064256:0@lo:104: 00010000:00010000:1.0:1787829774.569828:0:5800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e9b596cb800/0xc03b4d103c0d76f1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829774.570354:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284064384:0@lo:103: 00000100:00100000:2.0:1787829774.570407:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829774.570477:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284064896:0@lo:103: 00000100:00100000:2.0:1787829774.570496:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829774.570585:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787829774.570591:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284064512:0@lo:103: 00000100:00100000:2.0:1787829774.570610:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829774.570631:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284064384 00000100:00100000:1.0:1787829774.570636:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284064384 00010000:00010000:1.0:1787829774.570674:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d76dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d76d5 expref: 17 pid: 5799 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829774.570712:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284064896 00000100:00100000:0.0:1787829774.570716:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284064896 00010000:00010000:0.0:1787829774.570734:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b4164e000/0xc03b4d103c0d7642 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d763b expref: 18 pid: 5799 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829774.570775:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787829774.570784:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f547c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:3280:x1874675284064384:12345-0@lo:103: 00010000:00010000:0.0:1787829774.570799:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829774.570805:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d76dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d76d5 expref: 18 pid: 5799 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.570816:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d76dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d76d5 expref: 18 pid: 5799 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.570833:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d76dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d76d5 expref: 18 pid: 5799 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.570859:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829774.570893:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f547c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:3280:x1874675284064384:12345-0@lo:103: Request processed in 111us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829774.570910:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787829774.570926:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787829774.570932:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f5461c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:3280:x1874675284064896:12345-0@lo:103: 00010000:00010000:0.0:1787829774.570941:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829774.570954:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b4164e000/0xc03b4d103c0d7642 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d763b expref: 16 pid: 5799 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.570976:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b4164e000/0xc03b4d103c0d7642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d763b expref: 16 pid: 5799 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.570987:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b4164e000/0xc03b4d103c0d7642 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d763b expref: 16 pid: 5799 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.570996:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829774.571044:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f5461c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:3280:x1874675284064896:12345-0@lo:103: Request processed in 112us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829774.571050:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787829774.571568:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284064384:0@lo:103: 00000100:00100000:2.0:1787829774.571577:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284064896:0@lo:103: 00000100:00100000:2.0:1787829774.571613:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284064640:0@lo:103: 00000100:00100000:2.0:1787829774.571641:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829774.571765:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284064512 00000100:00100000:3.0:1787829774.571770:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284064512 00010000:00010000:3.0:1787829774.571791:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b4164fc00/0xc03b4d103c0d76b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d76ab expref: 15 pid: 5798 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829774.571805:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284064640 00000100:00100000:3.0:1787829774.571808:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284064640 00010000:00010000:3.0:1787829774.571819:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b596cae00/0xc03b4d103c0d7696 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d768f expref: 16 pid: 5800 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829774.571830:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787829774.571837:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f546580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:3280:x1874675284064512:12345-0@lo:103: 00010000:00010000:3.0:1787829774.571855:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829774.571860:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b4164fc00/0xc03b4d103c0d76b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d76ab expref: 16 pid: 5798 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.571868:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b4164fc00/0xc03b4d103c0d76b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d76ab expref: 16 pid: 5798 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.571901:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b4164fc00/0xc03b4d103c0d76b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d76ab expref: 16 pid: 5798 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.571914:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787829774.571958:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f546580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:3280:x1874675284064512:12345-0@lo:103: Request processed in 111us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829774.571966:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787829774.571979:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787829774.571985:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f545a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:3278:x1874675284064640:12345-0@lo:103: 00010000:00010000:3.0:1787829774.571993:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829774.571997:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b596cae00/0xc03b4d103c0d7696 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d768f expref: 14 pid: 5800 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.572006:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b596cae00/0xc03b4d103c0d7696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d768f expref: 14 pid: 5800 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.572040:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b596cae00/0xc03b4d103c0d7696 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d768f expref: 14 pid: 5800 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.572050:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787829774.572072:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f545a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:3278:x1874675284064640:12345-0@lo:103: Request processed in 87us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829774.572078:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787829774.572382:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787829774.572395:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284064768:0@lo:103: 00000100:00100000:2.0:1787829774.572422:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829774.572455:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284064640:0@lo:103: 00000100:00100000:2.0:1787829774.572485:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284064512:0@lo:103: 00000100:00100000:2.0:1787829774.572510:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284064768 00000100:00100000:2.0:1787829774.572514:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284064768 00010000:00010000:2.0:1787829774.572530:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b596cb200/0xc03b4d103c0d766c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d7665 expref: 13 pid: 5800 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829774.572547:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787829774.572553:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f547480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:3278:x1874675284064768:12345-0@lo:103: 00010000:00010000:2.0:1787829774.572560:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829774.572564:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b596cb200/0xc03b4d103c0d766c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d7665 expref: 13 pid: 5800 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.572573:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b596cb200/0xc03b4d103c0d766c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d7665 expref: 13 pid: 5800 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.572583:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b596cb200/0xc03b4d103c0d766c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d7665 expref: 13 pid: 5800 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.572595:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e9b596cb800/0xc03b4d103c0d76f1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.572604:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b596cb800/0xc03b4d103c0d76f1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.572620:0:5791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b596cb800/0xc03b4d103c0d76f1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.572628:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b596cb800/0xc03b4d103c0d76f1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.572635:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e9b596cb800/0xc03b4d103c0d76f1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.572652:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e9b596cb800/0xc03b4d103c0d76f1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.572658:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b596cb800 already unused, calling callback (ffffffffc1651420) 00010000:00010000:2.0:1787829774.572662:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e9b596cb800/0xc03b4d103c0d76f1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.573097:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e9b596cb800/0xc03b4d103c0d76f1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.573119:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e9b596cb800/0xc03b4d103c0d76f1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.573129:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787829774.573160:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f547480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:3278:x1874675284064768:12345-0@lo:103: Request processed in 608us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829774.573167:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787829774.573190:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284064768:0@lo:103: 00010000:00010000:0.0:1787829774.573276:0:5800:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e9b596cb800/0xc03b4d103c0d76f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.573284:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e9b596cb800/0xc03b4d103c0d76f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.573291:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b596cb800/0xc03b4d103c0d76f1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787829774.573313:0:5800:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787829774.629433:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+11:7586:x1874675284063616:12345-0@lo:253: Request processed in 83835us (84036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829774.629447:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787829774.629569:0:7586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f544000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284063616:0@lo:253: 10000000:01000000:2.0:1787829774.629581:0:7586:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787829774.629584:0:7586:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787829774.629585:0:7586:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787829774.629586:0:7586:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787829774.629587:0:7586:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1787829774.629588:0:7586:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787829774.629589:0:7586:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787829774.629590:0:7586:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787829774.629591:0:7586:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787829774.629592:0:7586:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787829774.629593:0:7586:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787829774.629622:0:7586:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e9b7f524800 from lustre-OST0001 10000000:01000000:2.0:1787829774.629641:0:7586:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787829774.629643:0:7586:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787829774.629650:0:7586:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e9b4f8419b8 local copy 10000000:01000000:2.0:1787829774.629653:0:7586:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787829774.629686:0:7586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f400/0xc03b4d103c0d76f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.629694:0:7586:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f400/0xc03b4d103c0d76f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.629701:0:7586:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f400/0xc03b4d103c0d76f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829774.629713:0:7586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f544000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284065024:0@lo:101: 00000100:00100000:2.0:1787829774.629740:0:7586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829774.629845:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284065024 00000100:00100000:0.0:1787829774.629851:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284065024 00000100:00100000:1.0:1787829774.629933:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787829774.629943:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+11:7586:x1874675284065024:12345-0@lo:101: 00010000:00010000:1.0:1787829774.629956:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829774.629970:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b48cda200/0xc03b4d103c0d76ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d76f8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829774.629993:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b48cda200/0xc03b4d103c0d76ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d76f8 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829774.630003:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b48cda200/0xc03b4d103c0d76ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d76f8 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829774.630043:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b48cda200, rc 0) 00000100:00100000:1.0:1787829774.630070:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:7586:x1874675284065024:12345-0@lo:101: Request processed in 129us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829774.630076:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787829774.630138:0:7586:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51e6ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787829774.630152:0:7586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f544000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284065024:0@lo:101: 00010000:00010000:2.0:1787829774.630163:0:7586:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f400/0xc03b4d103c0d76f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc03b4d103c0d76ff expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.630172:0:7586:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f400/0xc03b4d103c0d76f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc03b4d103c0d76ff expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829774.630270:0:7586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f544000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284065152:0@lo:501: 00000100:00100000:2.0:1787829774.630289:0:7586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829774.630317:0:7586:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51e6ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787829774.630349:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284065152 00000100:00100000:1.0:1787829774.630353:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284065152 00000100:00100000:0.0:1787829774.630427:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787829774.630434:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:7586:x1874675284065152:12345-0@lo:501: 00000100:00100000:0.0:1787829774.630589:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:7586:x1874675284065152:12345-0@lo:501: Request processed in 155us (297us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787829774.630596:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787829774.630620:0:7586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f544000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284065152:0@lo:501: 10000000:01000000:2.0:1787829774.630631:0:7586:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787829774.630657:0:7586:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787829774.630661:0:7586:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f400/0xc03b4d103c0d76f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc03b4d103c0d76ff expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.630666:0:7586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f400/0xc03b4d103c0d76f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc03b4d103c0d76ff expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.630671:0:7586:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f400/0xc03b4d103c0d76f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc03b4d103c0d76ff expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.630685:0:7586:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787829774.630703:0:7586:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e9b7f524800 10000000:01000000:2.0:1787829774.630708:0:7586:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787829774.630711:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1787829774.630713:0:7586:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787829774.630715:0:7586:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787829774.630717:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f400/0xc03b4d103c0d76f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc03b4d103c0d76ff expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787829774.630719:0:7586:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787829774.630722:0:7586:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787829774.630729:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164f400 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:0.0:1787829774.630733:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f400/0xc03b4d103c0d76f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc03b4d103c0d76ff expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.630735:0:7586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f000/0xc03b4d103c0d7706 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.630741:0:7586:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f000/0xc03b4d103c0d7706 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.630742:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f400/0xc03b4d103c0d76f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0xc03b4d103c0d76ff expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.630749:0:7586:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f000/0xc03b4d103c0d7706 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787829774.630750:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f400/0xc03b4d103c0d76f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0xc03b4d103c0d76ff expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787829774.630756:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787829774.630831:0:7586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f544000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284065280:0@lo:101: 00010000:00010000:0.0:1787829774.630834:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f400/0xc03b4d103c0d76f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc03b4d103c0d76ff expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.630840:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787829774.630866:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f400/0xc03b4d103c0d76f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc03b4d103c0d76ff expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.630873:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f400/0xc03b4d103c0d76f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc03b4d103c0d76ff expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.630886:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829774.630887:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829774.630889:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787829774.630932:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787829774.630944:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284065408:0@lo:103: 00000100:00100000:3.0:1787829774.630976:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829774.631006:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284065408 00000100:00100000:3.0:1787829774.631010:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284065408 00000100:00100000:3.0:1787829774.631076:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787829774.631083:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b596921c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:3280:x1874675284065408:12345-0@lo:103: 00010000:00010000:3.0:1787829774.631092:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829774.631104:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b48cda200/0xc03b4d103c0d76ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc03b4d103c0d76f8 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.631117:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787829774.631152:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b596921c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+11:3280:x1874675284065408:12345-0@lo:103: Request processed in 71us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829774.631159:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787829774.631224:0:7586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829774.631245:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284065408:0@lo:103: 00000100:00100000:2.0:1787829774.631249:0:7586:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51e6e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787829774.631326:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284065280 00000100:00100000:3.0:1787829774.631329:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284065280 00000100:00100000:3.0:1787829774.631349:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787829774.631356:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+11:7586:x1874675284065280:12345-0@lo:101: 00010000:00010000:3.0:1787829774.631364:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829774.631376:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b596cae00/0xc03b4d103c0d770d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d7706 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.631393:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b596cae00/0xc03b4d103c0d770d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d7706 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.631402:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b596cae00/0xc03b4d103c0d770d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7706 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.631409:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b596cae00, rc 0) 00000100:00100000:3.0:1787829774.631475:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:7586:x1874675284065280:12345-0@lo:101: Request processed in 120us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829774.631482:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787829774.631522:0:7586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f544000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284065280:0@lo:101: 00010000:00010000:2.0:1787829774.631537:0:7586:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f000/0xc03b4d103c0d7706 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d770d expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.631543:0:7586:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f000/0xc03b4d103c0d7706 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d770d expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829774.631588:0:7586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f544000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284065536:0@lo:501: 00000100:00100000:2.0:1787829774.631605:0:7586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829774.631620:0:7586:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51e6e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787829774.631635:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284065536 00000100:00100000:0.0:1787829774.631639:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284065536 00000100:00100000:0.0:1787829774.631664:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787829774.631670:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:7586:x1874675284065536:12345-0@lo:501: 00000100:00100000:0.0:1787829774.631898:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:7586:x1874675284065536:12345-0@lo:501: Request processed in 227us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829774.631944:0:7586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f544000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284065536:0@lo:501: 00000100:00100000:2.0:1787829774.631970:0:7586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f544000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284065664:0@lo:503: 00000100:00100000:2.0:1787829774.632006:0:7586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829774.632123:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787829774.632136:0:7586:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51e6e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787829774.632140:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284065664 00000100:00100000:0.0:1787829774.632143:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284065664 00000100:00100000:0.0:1787829774.632179:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787829774.632186:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:7586:x1874675284065664:12345-0@lo:503: 00000100:00100000:0.0:1787829774.632318:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:7586:x1874675284065664:12345-0@lo:503: Request processed in 132us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829774.632325:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787829774.632343:0:7586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f544000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284065664:0@lo:503: 00000040:00080000:2.0:1787829774.632572:0:7586:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787829774.632630:0:7586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f544000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284065792:0@lo:502: 00000100:00100000:2.0:1787829774.632657:0:7586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829774.632675:0:7586:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51e6e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787829774.632691:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284065792 00000100:00100000:0.0:1787829774.632695:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284065792 00000100:00100000:0.0:1787829774.632723:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787829774.632729:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:7586:x1874675284065792:12345-0@lo:502: 00000100:00100000:0.0:1787829774.633011:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:7586:x1874675284065792:12345-0@lo:502: Request processed in 281us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829774.633044:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787829774.633048:0:7586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f544000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284065792:0@lo:502: 00000040:00080000:2.0:1787829774.633270:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787829774.633301:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787829774.633378:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787829774.633415:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787829774.633435:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787829774.633450:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787829774.633466:0:7586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f544000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284065920:0@lo:502: 00000100:00100000:2.0:1787829774.633495:0:7586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829774.633519:0:7586:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51e6e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787829774.633554:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284065920 00000100:00100000:0.0:1787829774.633557:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284065920 00000100:00100000:0.0:1787829774.633579:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787829774.633586:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:7586:x1874675284065920:12345-0@lo:502: 00000100:00100000:0.0:1787829774.633716:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:7586:x1874675284065920:12345-0@lo:502: Request processed in 130us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829774.633720:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787829774.633821:0:7586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f544000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284065920:0@lo:502: 00000040:00080000:2.0:1787829774.633885:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787829774.633996:0:7586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1787829774.634645:0:7593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787829774.634652:0:7593:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787829774.634656:0:7593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787829774.634664:0:7593:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787829774.634668:0:7593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787829774.634680:0:7593:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9e9b69c299b8) 00000020:00000080:0.0:1787829774.634695:0:7593:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787829774.634699:0:7593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787829774.634748:0:7593:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e9b7f524800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787829774.634754:0:7593:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787829774.634760:0:7593:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc03b4d103c0d771b 00010000:00010000:0.0:1787829774.640157:0:7593:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1787829774.640542:0:7593:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1787829774.644396:0:7593:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787829774.645212:0:7593:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1787829774.649426:0:7593:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787829774.650502:0:7593:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787829774.654237:0:7593:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787829774.654252:0:7593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787829774.654259:0:7593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787829774.654261:0:7593:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787829774.654265:0:7593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787829774.654269:0:7593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787829774.654271:0:7593:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787829774.654274:0:7593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787829774.654276:0:7593:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787829774.654344:0:7593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787829774.654348:0:7593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787829774.654350:0:7593:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787829774.654354:0:7593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787829774.656960:0:7586:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1787829774.657001:0:7586:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787829774.657048:0:7586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f000/0xc03b4d103c0d7706 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d770d expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829774.657072:0:7586:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f000/0xc03b4d103c0d7706 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d770d expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787829774.657082:0:7586:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9b7f524800 from 1 10000000:01000000:1.0:1787829774.657085:0:7586:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787829774.657125:0:7586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdaa00/0xc03b4d103c0d7722 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829774.657133:0:7586:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdaa00/0xc03b4d103c0d7722 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829774.657144:0:7586:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdaa00/0xc03b4d103c0d7722 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829774.657168:0:7586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284066048:0@lo:101: 00000100:00100000:1.0:1787829774.657232:0:7586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829774.657287:0:7586:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b75ca4180 going to sleep for 11 seconds 00000100:00100000:0.0:1787829774.657337:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284066048 00000100:00100000:0.0:1787829774.657345:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284066048 00000100:00100000:0.0:1787829774.657402:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787829774.657412:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:7586:x1874675284066048:12345-0@lo:101: 00010000:00010000:0.0:1787829774.657425:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829774.657443:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b40030a00/0xc03b4d103c0d7729 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d7722 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.657470:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b40030a00/0xc03b4d103c0d7729 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d7722 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.657481:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b40030a00/0xc03b4d103c0d7729 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7722 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.657489:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b40030a00, rc 0) 00000100:00100000:0.0:1787829774.657532:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:7586:x1874675284066048:12345-0@lo:101: Request processed in 121us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829774.657539:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787829774.657883:0:7586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284066048:0@lo:101: 00010000:00010000:1.0:1787829774.657898:0:7586:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdaa00/0xc03b4d103c0d7722 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7729 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829774.657907:0:7586:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdaa00/0xc03b4d103c0d7722 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d7729 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829774.658012:0:7586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284066176:0@lo:501: 00000100:00100000:1.0:1787829774.658076:0:7586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829774.658094:0:7586:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b75ca4180 going to sleep for 11 seconds 00000100:00100000:2.0:1787829774.658344:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284066176 00000100:00100000:2.0:1787829774.658349:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284066176 00000100:00100000:2.0:1787829774.658383:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787829774.658390:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:7586:x1874675284066176:12345-0@lo:501: 00000100:00100000:2.0:1787829774.658598:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:7586:x1874675284066176:12345-0@lo:501: Request processed in 207us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829774.658605:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787829774.658637:0:7586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284066176:0@lo:501: 00000100:00100000:2.0:1787829774.658664:0:7586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f544000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284066304:0@lo:503: 00000100:00100000:2.0:1787829774.658697:0:7586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829774.658708:0:7586:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51e6e000 going to sleep for 11 seconds 00000100:00100000:1.0:1787829774.658869:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284066304 00000100:00100000:1.0:1787829774.658874:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284066304 00000100:00100000:1.0:1787829774.658903:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787829774.658909:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:7586:x1874675284066304:12345-0@lo:503: 00000100:00100000:1.0:1787829774.659232:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:7586:x1874675284066304:12345-0@lo:503: Request processed in 322us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829774.659239:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787829774.659355:0:7586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f544000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284066304:0@lo:503: 00000040:00080000:3.0:1787829774.659623:0:7586:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787829774.659679:0:7586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b59693c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284066432:0@lo:502: 00000100:00100000:3.0:1787829774.659716:0:7586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829774.659737:0:7586:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fb653c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787829774.659917:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284066432 00000100:00100000:1.0:1787829774.659922:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284066432 00000100:00100000:1.0:1787829774.659966:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787829774.659973:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:7586:x1874675284066432:12345-0@lo:502: 00000100:00100000:1.0:1787829774.660139:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:7586:x1874675284066432:12345-0@lo:502: Request processed in 165us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829774.660145:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787829774.660181:0:7586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b59693c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284066432:0@lo:502: 00000040:00080000:1.0:1787829774.660425:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787829774.660469:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787829774.660495:0:7586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa45e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284066560:0@lo:502: 00000100:00100000:1.0:1787829774.660526:0:7586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829774.660547:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284066560 00000100:00100000:1.0:1787829774.660550:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284066560 00000100:00100000:1.0:1787829774.660566:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787829774.660572:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:7586:x1874675284066560:12345-0@lo:502: 00000100:00100000:1.0:1787829774.660669:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:7586:x1874675284066560:12345-0@lo:502: Request processed in 97us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829774.660675:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787829774.660707:0:7586:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b7a507600 going to sleep for 11 seconds 00000100:00100000:1.0:1787829774.660717:0:7586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa45e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284066560:0@lo:502: 00000040:00080000:1.0:1787829774.661344:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787829774.661356:0:7586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787829774.665819:0:7597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787829774.665837:0:7597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787829774.665839:0:7597:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787829774.665857:0:7597:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e9b7f524800 00000020:00000080:3.0:1787829774.665860:0:7597:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787829774.665880:0:7597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787829774.665884:0:7597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787829774.665885:0:7597:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787829774.665888:0:7597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787829774.666175:0:7586:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787829774.666198:0:7586:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787829774.666215:0:7586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdaa00/0xc03b4d103c0d7722 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7729 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829774.666226:0:7586:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdaa00/0xc03b4d103c0d7722 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7729 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787829774.666269:0:7586:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787829774.666272:0:7586:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e9b7f524800 10000000:01000000:1.0:1787829774.666275:0:7586:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e9b7f524800 10000000:01000000:1.0:1787829774.666279:0:7586:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787829774.666284:0:7586:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e9b7f524800 from 1 10000000:01000000:1.0:1787829774.666287:0:7586:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787829774.666331:0:7586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7730 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829774.666353:0:7586:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7730 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829774.666364:0:7586:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7730 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829774.666387:0:7586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa45e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284066688:0@lo:101: 00000100:00100000:1.0:1787829774.666474:0:7586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829774.666515:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284066688 00000100:00100000:1.0:1787829774.666522:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284066688 00000100:00100000:1.0:1787829774.666567:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787829774.666577:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:7586:x1874675284066688:12345-0@lo:101: 00010000:00010000:1.0:1787829774.666590:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829774.666603:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b48cda800/0xc03b4d103c0d7737 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d7730 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829774.666624:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b48cda800/0xc03b4d103c0d7737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d7730 expref: 14 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829774.666635:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b48cda800/0xc03b4d103c0d7737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7730 expref: 14 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829774.666644:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b48cda800, rc 0) 00000100:00100000:1.0:1787829774.666676:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:7586:x1874675284066688:12345-0@lo:101: Request processed in 100us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829774.666683:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787829774.666724:0:7586:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b7a507540 going to sleep for 11 seconds 00000100:00100000:1.0:1787829774.666744:0:7586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa45e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284066688:0@lo:101: 00010000:00010000:1.0:1787829774.666764:0:7586:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7730 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7737 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829774.666773:0:7586:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7730 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d7737 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829774.666940:0:7586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa45e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284066816:0@lo:501: 00000100:00100000:1.0:1787829774.667058:0:7586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829774.667070:0:7586:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b7a507540 going to sleep for 11 seconds 00000100:00100000:3.0:1787829774.667255:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284066816 00000100:00100000:3.0:1787829774.667260:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284066816 00000100:00100000:3.0:1787829774.667311:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787829774.667320:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:7586:x1874675284066816:12345-0@lo:501: 00000100:00100000:3.0:1787829774.667527:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:7586:x1874675284066816:12345-0@lo:501: Request processed in 208us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829774.667535:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787829774.667613:0:7586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa45e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284066816:0@lo:501: 00000100:00100000:0.0:1787829774.667643:0:7586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284066944:0@lo:503: 00000100:00100000:0.0:1787829774.667680:0:7586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829774.667705:0:7586:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b587d8240 going to sleep for 11 seconds 00000100:00100000:3.0:1787829774.667742:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284066944 00000100:00100000:3.0:1787829774.667746:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284066944 00000100:00100000:3.0:1787829774.667762:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787829774.667767:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:7586:x1874675284066944:12345-0@lo:503: 00000100:00100000:3.0:1787829774.667915:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:7586:x1874675284066944:12345-0@lo:503: Request processed in 146us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829774.667922:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787829774.668109:0:7586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284066944:0@lo:503: 00000040:00080000:0.0:1787829774.668370:0:7586:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787829774.668422:0:7586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284067072:0@lo:502: 00000100:00100000:0.0:1787829774.668463:0:7586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829774.668480:0:7586:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b42cfad80 going to sleep for 11 seconds 00000100:00100000:3.0:1787829774.668533:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284067072 00000100:00100000:3.0:1787829774.668543:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284067072 00000100:00100000:3.0:1787829774.668561:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787829774.668566:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:7586:x1874675284067072:12345-0@lo:502: 00000100:00100000:3.0:1787829774.668720:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:7586:x1874675284067072:12345-0@lo:502: Request processed in 152us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829774.668727:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787829774.668854:0:7586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284067072:0@lo:502: 00000040:00080000:0.0:1787829774.669131:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787829774.669175:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787829774.669205:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787829774.669244:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787829774.669729:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787829774.669801:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787829774.670005:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787829774.670110:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787829774.670159:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787829774.670192:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787829774.670224:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787829774.670281:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787829774.670330:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787829774.670364:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787829774.670428:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787829774.670464:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787829774.670492:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787829774.670532:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787829774.670561:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787829774.670589:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787829774.670629:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787829774.670658:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787829774.670684:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787829774.670723:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787829774.670752:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787829774.670782:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787829774.670823:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787829774.670870:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1787829774.670906:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787829774.673180:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1787829774.673271:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1787829774.673315:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1787829774.673348:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1787829774.673398:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1787829774.673428:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1787829774.673468:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1787829774.673498:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1787829774.673543:0:7586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284067200:0@lo:502: 00000100:00100000:0.0:1787829774.673620:0:7586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829774.673714:0:7586:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b587d8240 going to sleep for 11 seconds 00000100:00100000:1.0:1787829774.673800:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284067200 00000100:00100000:1.0:1787829774.673808:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284067200 00000100:00100000:1.0:1787829774.673959:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787829774.673969:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:7586:x1874675284067200:12345-0@lo:502: 00000100:00100000:1.0:1787829774.674207:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:7586:x1874675284067200:12345-0@lo:502: Request processed in 239us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829774.674216:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787829774.674313:0:7586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284067200:0@lo:502: 00000040:00080000:0.0:1787829774.674383:0:7586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1787829774.674393:0:7586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787829774.674855:0:7598:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787829774.674869:0:7598:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9e9b69c28000) 00000020:00000080:0.0:1787829774.674890:0:7598:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1787829774.674957:0:7598:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e9b7f524800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787829774.674961:0:7598:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e9b7f524800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787829774.674963:0:7598:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e9b7f524800 3 00010000:00080000:0.0:1787829774.674994:0:7598:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e9b81f0b000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.151@tcp at head 00010000:00010000:0.0:1787829774.676530:0:7598:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1787829774.676719:0:7598:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787829774.676750:0:7598:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787829774.676762:0:7598:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc03b4d103c0d7745 00000100:00080000:0.0:1787829774.676771:0:7598:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787829774.676776:0:7598:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e9b81f0b000 using connection 192.168.201.151@tcp/0@lo 00000100:00100000:0.0:1787829774.676808:0:7598:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b48ebc780 x1874675284067328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787829774.676832:0:7598:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:0.0:1787829774.677060:0:7598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:0.0:1787829774.677175:0:7599:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9e9b48ebde00 x1874675284067456/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829774.677185:0:7599:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b75ca49c0 going to sleep for 0 seconds 00000020:01000000:3.0:1787829774.678754:0:7586:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1787829774.678793:0:7586:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787829774.678813:0:7586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7730 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7737 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.678825:0:7586:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7730 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7737 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787829774.678888:0:7586:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787829774.678890:0:7586:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787829774.678892:0:7586:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787829774.678893:0:7586:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787829774.678894:0:7586:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787829774.678896:0:7586:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787829774.678897:0:7586:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787829774.678899:0:7586:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787829774.678900:0:7586:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787829774.678901:0:7586:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787829774.678903:0:7586:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787829774.678906:0:7586:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1787829774.678909:0:7586:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787829774.678910:0:7586:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787829774.678911:0:7586:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787829774.678912:0:7586:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787829774.678913:0:7586:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787829774.678914:0:7586:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787829774.678915:0:7586:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787829774.678916:0:7586:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787829774.678917:0:7586:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787829774.678923:0:7586:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787829774.678924:0:7586:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787829774.678944:0:7586:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787829774.678958:0:7586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b59690000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284067584:0@lo:253: 00000100:00100000:3.0:1787829774.679047:0:7586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829774.684510:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284067584 00000100:00100000:2.0:1787829774.684522:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284067584 00000100:00100000:2.0:1787829774.684572:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787829774.684581:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:7586:x1874675284067584:12345-0@lo:253: 20000000:01000000:2.0:1787829774.684613:0:5799:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787829774.684627:0:5799:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787829774.685201:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1874675284067328:0@lo:38: 00000100:00100000:2.0:1787829774.685267:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829774.685340:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284067328 00000100:00100000:2.0:1787829774.685344:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284067328 00000100:00100000:2.0:1787829774.685367:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787829774.685379:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f544b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1874675284067328:12345-0@lo:38: 00010000:00080000:2.0:1787829774.685400:0:5804:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:2.0:1787829774.685448:0:5804:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc03b4d103c0d774c 00000004:00100000:2.0:1787829774.685463:0:5804:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787829774.685496:0:5804:0:(import.c:65:import_set_state_nolock()) ffff9e9b75da5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787829774.685543:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f544b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1874675284067328:12345-0@lo:38: Request processed in 164us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829774.685549:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787829774.685592:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b48ebc780 x1874675284067328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787829784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829774.685601:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787829774.685609:0:3277:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787829774.685617:0:3277:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787829774.685621:0:3277:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787829774.685623:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9e9b81f0b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787829774.685629:0:3277:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000054dd6b50): req@ffff9e9b48ebde00 x1874675284067456/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829774.685642:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1874675284067328:0@lo:38: 00000100:00100000:0.0:1787829774.685873:0:7599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829774.685890:0:7599:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b75ca49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787829774.686122:0:7586:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b42cb3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787829774.686212:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284067456 00000100:00100000:2.0:1787829774.686216:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284067456 00000100:00100000:2.0:1787829774.686258:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787829774.686264:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ebd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7599:x1874675284067456:12345-0@lo:901: 00000100:00100000:2.0:1787829774.686555:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ebd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7599:x1874675284067456:12345-0@lo:901: Request processed in 291us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829774.686563:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787829774.686592:0:7599:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b48ebde00 x1874675284067456/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787829790 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829774.686610:0:7599:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebde00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7599:1874675284067456:0@lo:901: 00000100:00080000:1.0:1787829774.686739:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:0.0:1787829774.705913:0:5799:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787829774.706046:0:5799:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787829774.708605:0:5820:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787829774.708615:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787829774.708685:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e9b40030e00/0xc03b4d103c0d7753 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.708706:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b4164e600/0xc03b4d103c0d76a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d769d expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.708716:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e9b40030e00/0xc03b4d103c0d7753 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.708756:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b4164e600/0xc03b4d103c0d76a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d769d expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.708771:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e9b4164e600/0xc03b4d103c0d76a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d769d expref: 14 pid: 5798 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829774.708785:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebde00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5820:1874675284067712:0@lo:104: 00000100:00100000:0.0:1787829774.708860:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829774.708902:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fb36e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787829774.709110:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284067712 00000100:00100000:3.0:1787829774.709119:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284067712 00000100:00100000:3.0:1787829774.709171:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787829774.709180:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ebc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:5820:x1874675284067712:12345-0@lo:104: 00010000:00010000:3.0:1787829774.709194:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b40030400/0xc03b4d103c0d769d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d76a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.709284:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787829774.709290:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ebc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:5820:x1874675284067712:12345-0@lo:104: Request processed in 112us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829774.709298:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787829774.709329:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787829774.709335:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b40030400/0xc03b4d103c0d769d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d76a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.709343:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40030400 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:3.0:1787829774.709347:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b40030400/0xc03b4d103c0d769d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d76a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.709357:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b40030400/0xc03b4d103c0d769d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d76a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787829774.709365:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b40030400/0xc03b4d103c0d769d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d76a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787829774.709371:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787829774.709414:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b40030400/0xc03b4d103c0d769d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d76a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.709421:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787829774.709437:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b40030400/0xc03b4d103c0d769d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d76a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.709444:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b40030400/0xc03b4d103c0d769d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d76a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829774.709459:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829774.709461:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829774.709463:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787829774.709480:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b59690f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284067840:0@lo:103: 00000100:00100000:3.0:1787829774.709510:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829774.709656:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284067840 00000100:00100000:2.0:1787829774.709661:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284067840 00010000:00010000:2.0:1787829774.709680:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b4164e600/0xc03b4d103c0d76a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d769d expref: 15 pid: 5798 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829774.709707:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787829774.709713:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b51a06850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:3278:x1874675284067840:12345-0@lo:103: 00010000:00010000:2.0:1787829774.709723:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829774.709728:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b4164e600/0xc03b4d103c0d76a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d769d expref: 15 pid: 5798 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.709738:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b4164e600/0xc03b4d103c0d76a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d769d expref: 15 pid: 5798 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.709754:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e9b40030e00/0xc03b4d103c0d7753 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.709763:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b40030e00/0xc03b4d103c0d7753 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787829774.709776:0:5792:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001659064s 00010000:00010000:2.0:1787829774.709780:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b40030e00/0xc03b4d103c0d7753 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.709787:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b40030e00/0xc03b4d103c0d7753 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.709804:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e9b40030e00/0xc03b4d103c0d7753 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.709811:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e9b40030e00/0xc03b4d103c0d7753 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.709817:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40030e00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:2.0:1787829774.709820:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e9b40030e00/0xc03b4d103c0d7753 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.709828:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e9b40030e00/0xc03b4d103c0d7753 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.709837:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e9b40030e00/0xc03b4d103c0d7753 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829774.709857:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787829774.709888:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b51a06850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:3278:x1874675284067840:12345-0@lo:103: Request processed in 174us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829774.709895:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787829774.710113:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b59690f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284067840:0@lo:103: 00010000:00010000:0.0:1787829774.710861:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b4164e600/0xc03b4d103c0d76a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d769d expref: 14 pid: 5798 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829774.710877:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebde00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5820:1874675284067712:0@lo:104: 00010000:00010000:0.0:1787829774.710896:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e9b40030e00/0xc03b4d103c0d7753 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.710906:0:5820:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e9b40030e00/0xc03b4d103c0d7753 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.710911:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e9b40030e00/0xc03b4d103c0d7753 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829774.710926:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b40030e00/0xc03b4d103c0d7753 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829774.714667:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:7586:x1874675284067584:12345-0@lo:253: Request processed in 30077us (35609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829774.714682:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787829774.714766:0:7586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b59690000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ff77d2d-a894-4919-b9b2-0fa36523bae1:7586:1874675284067584:0@lo:253: 10000000:01000000:3.0:1787829774.714781:0:7586:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787829774.714784:0:7586:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787829774.714786:0:7586:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787829774.714787:0:7586:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787829774.714788:0:7586:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787829774.714789:0:7586:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787829774.714791:0:7586:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787829774.714792:0:7586:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787829774.714794:0:7586:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787829774.714795:0:7586:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787829774.714797:0:7586:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787829774.714798:0:7586:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787829774.714812:0:7586:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787829774.723754:0:7586:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787829774.724636:0:7586:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787829774.724924:0:7586:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787829774.725387:0:7586:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787829774.725585:0:7586:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787829774.725790:0:7586:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787829774.727138:0:7586:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787829774.967590:0:7586:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787829774.967597:0:7586:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787829774.967628:0:7586:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787829774.967688:0:7586:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.151@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787829774.967702:0:7586:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787829774.967729:0:7586:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787829775.010290:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829776.035500:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829777.069749:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829778.085335:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829779.106408:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787829779.309300:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284067968:0@lo:13: 00000100:00100000:3.0:1787829779.310386:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829779.311795:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284067968 00000100:00100000:0.0:1787829779.311806:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284067968 00000100:00100000:0.0:1787829779.311894:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787829779.311907:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b59690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284067968:12345-0@lo:13: 00002000:00000024:0.0:1787829779.311946:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787829779.312046:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b59690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284067968:12345-0@lo:13: Request processed in 142us (1662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829779.312054:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787829779.312277:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7fa443c0 x1874675284067968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829779.312299:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284067968:0@lo:13: 00000100:00080000:1.0:1787829779.312728:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787829779.811188:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284068352:0@lo:400: 00000100:00100000:2.0:1787829779.811276:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829779.811335:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787829779.811341:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f546d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284068480:0@lo:400: 00000100:00100000:2.0:1787829779.811365:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829779.811401:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284068352 00000100:00100000:2.0:1787829779.811409:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284068352 00000100:00100000:2.0:1787829779.811468:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284068480 00000100:00100000:2.0:1787829779.811471:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284068480 00000100:00100000:2.0:1787829779.811496:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787829779.811504:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f544780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284068352:12345-0@lo:400: 00000100:00100000:2.0:1787829779.811556:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f544780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284068352:12345-0@lo:400: Request processed in 52us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829779.811564:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787829779.811581:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787829779.811587:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f5470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1874675284068480:12345-0@lo:400: 00000100:00100000:2.0:1787829779.811614:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f5470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1874675284068480:12345-0@lo:400: Request processed in 27us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829779.811619:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787829779.811662:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f546d00 x1874675284068480/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787829795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829779.811678:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f546d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284068480:0@lo:400: 00010000:00080000:2.0:1787829779.811689:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f547480 x1874675284068352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787829795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829779.811696:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284068352:0@lo:400: 00000100:00100000:1.0:1787829779.812064:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f546580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284068096:0@lo:400: 00000100:00100000:1.0:1787829779.812113:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829779.812144:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787829779.812150:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f545a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874675284068224:0@lo:400: 00000100:00100000:1.0:1787829779.812175:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787829779.812202:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787829779.813200:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284068096 00000100:00100000:2.0:1787829779.813231:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284068096 00000100:00100000:2.0:1787829779.813277:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787829779.813287:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:3280:x1874675284068096:12345-0@lo:400: 00000100:00100000:2.0:1787829779.813352:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:3280:x1874675284068096:12345-0@lo:400: Request processed in 66us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829779.813358:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787829779.813408:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f546580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284068096:0@lo:400: 00000100:00100000:2.0:1787829779.813432:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284068224 00000100:00100000:2.0:1787829779.813435:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284068224 00000100:00100000:2.0:1787829779.813460:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787829779.813466:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874675284068224:12345-0@lo:400: 00000100:00100000:2.0:1787829779.813501:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874675284068224:12345-0@lo:400: Request processed in 36us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829779.813508:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787829779.813535:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f545a40 x1874675284068224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787829795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829779.813547:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f545a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874675284068224:0@lo:400: 00010000:00010000:1.0:1787829780.130249:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829781.157308:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787829782.103441:0:7940:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg151-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787829782.179205:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829783.202127:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829784.226655:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787829784.419355:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787829784.419367:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e9b53977800 from 30 10000000:01000000:0.0:1787829784.419397:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787829784.419459:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d775a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829784.419475:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d775a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829784.419506:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d775a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829784.419540:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284068608:0@lo:101: 00000100:00100000:0.0:1787829784.419660:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829784.419754:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b42cfa780 going to sleep for 11 seconds 00000100:00100000:3.0:1787829784.419929:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284068608 00000100:00100000:3.0:1787829784.419938:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284068608 00000100:00100000:3.0:1787829784.420007:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787829784.420044:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:5802:x1874675284068608:12345-0@lo:101: 00010000:00010000:3.0:1787829784.420062:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829784.420081:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b596ca800/0xc03b4d103c0d7761 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d775a expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829784.420111:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b596ca800/0xc03b4d103c0d7761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d775a expref: 14 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829784.420123:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b596ca800/0xc03b4d103c0d7761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d775a expref: 14 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829784.420142:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b596ca800, rc 0) 00000100:00100000:3.0:1787829784.420190:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:5802:x1874675284068608:12345-0@lo:101: Request processed in 173us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829784.420197:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787829784.420748:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787829784.420767:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284068736:0@lo:13: 00000100:00100000:1.0:1787829784.420829:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829784.420875:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284068736 00000100:00100000:1.0:1787829784.420881:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284068736 00000100:00100000:1.0:1787829784.420933:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787829784.420941:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa45680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284068736:12345-0@lo:13: 00002000:00000024:1.0:1787829784.420980:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787829784.421051:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa45680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284068736:12345-0@lo:13: Request processed in 110us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829784.421059:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787829784.421080:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787829784.421140:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7fa44f00 x1874675284068736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829784.421163:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284068736:0@lo:13: 00000100:00100000:0.0:1787829784.421663:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284068608:0@lo:101: 00010000:00010000:0.0:1787829784.421696:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d775a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7761 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829784.421708:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d775a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d7761 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829784.421786:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284068864:0@lo:501: 00000100:00100000:0.0:1787829784.421825:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829784.421861:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b42cfa780 going to sleep for 11 seconds 00000100:00100000:2.0:1787829784.421925:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284068864 00000100:00100000:2.0:1787829784.421930:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284068864 00000100:00100000:2.0:1787829784.421970:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787829784.421978:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:5802:x1874675284068864:12345-0@lo:501: 00000100:00100000:2.0:1787829784.422509:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:5802:x1874675284068864:12345-0@lo:501: Request processed in 510us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829784.422518:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787829784.424114:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284068864:0@lo:501: 00000100:00100000:1.0:1787829784.424196:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa44f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284068992:0@lo:503: 00000100:00100000:1.0:1787829784.425111:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829784.425181:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47f4b840 going to sleep for 11 seconds 00000100:00100000:3.0:1787829784.425967:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284068992 00000100:00100000:3.0:1787829784.425981:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284068992 00000100:00100000:3.0:1787829784.426070:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787829784.426093:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:5802:x1874675284068992:12345-0@lo:503: 00000100:00100000:3.0:1787829784.427153:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:5802:x1874675284068992:12345-0@lo:503: Request processed in 1065us (2041us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829784.427181:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787829784.428296:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa44f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284068992:0@lo:503: 00000100:00100000:2.0:1787829784.429817:0:8045:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f546580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8045:1874675284069120:0@lo:502: 00000100:00100000:2.0:1787829784.429935:0:8045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829784.430002:0:8045:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fb36000 going to sleep for 11 seconds 00000100:00100000:0.0:1787829784.432064:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284069120 00000100:00100000:0.0:1787829784.432082:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284069120 00000100:00100000:0.0:1787829784.432183:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787829784.432196:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:8045:x1874675284069120:12345-0@lo:502: 00000100:00100000:0.0:1787829784.438423:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:8045:x1874675284069120:12345-0@lo:502: Request processed in 6215us (8475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829784.438471:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787829784.441244:0:8045:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f546580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8045:1874675284069120:0@lo:502: 00000100:00100000:2.0:1787829784.441366:0:8045:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f546580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8045:1874675284069248:0@lo:502: 00000100:00100000:2.0:1787829784.441461:0:8045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829784.441527:0:8045:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fb36000 going to sleep for 11 seconds 00000100:00100000:0.0:1787829784.443125:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284069248 00000100:00100000:0.0:1787829784.443151:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284069248 00000100:00100000:0.0:1787829784.443250:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787829784.443263:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:8045:x1874675284069248:12345-0@lo:502: 00000100:00100000:0.0:1787829784.443927:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:8045:x1874675284069248:12345-0@lo:502: Request processed in 663us (2462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829784.443937:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787829784.445288:0:8045:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f546580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8045:1874675284069248:0@lo:502: 00000040:00080000:2.0:1787829784.445356:0:8045:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787829784.446113:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787829784.446162:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787829784.446178:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d775a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7761 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829784.446193:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d775a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7761 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787829784.446229:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787829784.446233:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1787829784.446236:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787829784.446288:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7768 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829784.446297:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7768 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829784.446307:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7768 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829784.446334:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa44f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284069376:0@lo:101: 00000100:00100000:1.0:1787829784.446422:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829784.446482:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47f4b840 going to sleep for 11 seconds 00000100:00100000:0.0:1787829784.446914:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284069376 00000100:00100000:0.0:1787829784.446923:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284069376 00000100:00100000:0.0:1787829784.446989:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787829784.447001:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:5802:x1874675284069376:12345-0@lo:101: 00010000:00010000:0.0:1787829784.447063:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829784.447092:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b40031800/0xc03b4d103c0d776f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d7768 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829784.447124:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b40031800/0xc03b4d103c0d776f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d7768 expref: 15 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829784.447145:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b40031800/0xc03b4d103c0d776f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7768 expref: 15 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829784.447154:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b40031800, rc 0) 00000100:00100000:0.0:1787829784.447213:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:5802:x1874675284069376:12345-0@lo:101: Request processed in 213us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829784.447220:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787829784.448981:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa44f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284069376:0@lo:101: 00010000:00010000:1.0:1787829784.449074:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7768 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d776f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829784.449099:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7768 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d776f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829784.449221:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa44f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284069504:0@lo:501: 00000100:00100000:1.0:1787829784.449299:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829784.449354:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47f4b840 going to sleep for 11 seconds 00000100:00100000:3.0:1787829784.449579:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284069504 00000100:00100000:3.0:1787829784.449586:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284069504 00000100:00100000:3.0:1787829784.449636:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787829784.449646:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:5802:x1874675284069504:12345-0@lo:501: 00000100:00100000:3.0:1787829784.450066:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:5802:x1874675284069504:12345-0@lo:501: Request processed in 420us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829784.450074:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787829784.455180:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa44f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284069504:0@lo:501: 00000100:00100000:1.0:1787829784.455273:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa44f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284069632:0@lo:503: 00000100:00100000:1.0:1787829784.455392:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829784.455449:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47f4b840 going to sleep for 11 seconds 00000100:00100000:3.0:1787829784.461010:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284069632 00000100:00100000:3.0:1787829784.461057:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284069632 00000100:00100000:3.0:1787829784.461167:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787829784.461179:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:5802:x1874675284069632:12345-0@lo:503: 00000100:00100000:3.0:1787829784.462279:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:5802:x1874675284069632:12345-0@lo:503: Request processed in 1095us (6879us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829784.462292:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787829784.463009:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa44f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284069632:0@lo:503: 00000100:00100000:0.0:1787829784.466966:0:8046:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8046:1874675284069760:0@lo:502: 00000100:00100000:0.0:1787829784.467171:0:8046:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829784.467233:0:8046:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b42cfac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787829784.467386:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284069760 00000100:00100000:3.0:1787829784.467395:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284069760 00000100:00100000:3.0:1787829784.467457:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787829784.467469:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:8046:x1874675284069760:12345-0@lo:502: 00000100:00100000:3.0:1787829784.467852:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:8046:x1874675284069760:12345-0@lo:502: Request processed in 385us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829784.467861:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787829784.470754:0:8046:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8046:1874675284069760:0@lo:502: 00000020:01000000:1.0:1787829784.470821:0:8046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787829784.470840:0:8046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787829784.470843:0:8046:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787829784.470850:0:8046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787829784.470852:0:8046:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787829784.470901:0:8046:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa44f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8046:1874675284069888:0@lo:502: 00000100:00100000:1.0:1787829784.471006:0:8046:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829784.471352:0:8046:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47f4b840 going to sleep for 11 seconds 00000100:00100000:3.0:1787829784.472904:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284069888 00000100:00100000:3.0:1787829784.472923:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284069888 00000100:00100000:3.0:1787829784.473064:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787829784.473078:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:8046:x1874675284069888:12345-0@lo:502: 00000100:00100000:3.0:1787829784.473964:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:8046:x1874675284069888:12345-0@lo:502: Request processed in 885us (2953us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829784.473974:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787829784.474266:0:8046:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa44f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8046:1874675284069888:0@lo:502: 00000020:01000000:1.0:1787829784.474309:0:8046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787829784.474318:0:8046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787829784.474320:0:8046:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787829784.474326:0:8046:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787829784.474570:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787829784.474594:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787829784.474607:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7768 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d776f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829784.474619:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d776f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787829784.474631:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787829784.474634:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e9b51a3b000 from 30 10000000:01000000:0.0:1787829784.474638:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787829784.474694:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b40031400/0xc03b4d103c0d7776 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829784.474703:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b40031400/0xc03b4d103c0d7776 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829784.474712:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b40031400/0xc03b4d103c0d7776 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829784.474735:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284070016:0@lo:101: 00000100:00100000:0.0:1787829784.474796:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829784.474845:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b42cfac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787829784.475225:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284070016 00000100:00100000:1.0:1787829784.475233:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284070016 00000100:00100000:1.0:1787829784.475289:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787829784.475299:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:5802:x1874675284070016:12345-0@lo:101: 00010000:00010000:1.0:1787829784.475313:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829784.475330:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b48cda200/0xc03b4d103c0d777d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d7776 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829784.475359:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b48cda200/0xc03b4d103c0d777d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d7776 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829784.475394:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b48cda200/0xc03b4d103c0d777d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7776 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829784.475404:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b48cda200, rc 0) 00000100:00100000:1.0:1787829784.475449:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:5802:x1874675284070016:12345-0@lo:101: Request processed in 152us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829784.475457:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787829784.475589:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284070016:0@lo:101: 00010000:00010000:0.0:1787829784.475605:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b40031400/0xc03b4d103c0d7776 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d777d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829784.475615:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b40031400/0xc03b4d103c0d7776 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d777d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829784.475806:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284070144:0@lo:501: 00000100:00100000:0.0:1787829784.475842:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829784.475873:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b42cfac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787829784.475940:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284070144 00000100:00100000:2.0:1787829784.475945:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284070144 00000100:00100000:2.0:1787829784.475972:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787829784.475979:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:5802:x1874675284070144:12345-0@lo:501: 00000100:00100000:2.0:1787829784.476355:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:5802:x1874675284070144:12345-0@lo:501: Request processed in 375us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829784.476363:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787829784.477764:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284070144:0@lo:501: 00000100:00100000:0.0:1787829784.477844:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284070272:0@lo:503: 00000100:00100000:0.0:1787829784.477940:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829784.477988:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b42cfac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787829784.478282:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284070272 00000100:00100000:2.0:1787829784.478291:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284070272 00000100:00100000:2.0:1787829784.478355:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787829784.478365:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:5802:x1874675284070272:12345-0@lo:503: 00000100:00100000:2.0:1787829784.481904:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:5802:x1874675284070272:12345-0@lo:503: Request processed in 3526us (3950us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829784.481923:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787829784.482374:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284070272:0@lo:503: 00000100:00100000:1.0:1787829784.484846:0:8047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa44f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8047:1874675284070400:0@lo:502: 00000100:00100000:1.0:1787829784.484980:0:8047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829784.485074:0:8047:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b587bac00 going to sleep for 11 seconds 00000100:00100000:0.0:1787829784.489128:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284070400 00000100:00100000:0.0:1787829784.489161:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284070400 00000100:00100000:0.0:1787829784.489264:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787829784.489276:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:8047:x1874675284070400:12345-0@lo:502: 00000100:00100000:1.0:1787829784.496297:0:8047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa44f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8047:1874675284070400:0@lo:502: 00000100:00100000:1.0:1787829784.496405:0:8047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa44f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8047:1874675284070528:0@lo:502: 00000100:00100000:1.0:1787829784.496474:0:8047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829784.496650:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284070528 00000100:00100000:2.0:1787829784.496660:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284070528 00000100:00100000:2.0:1787829784.496737:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787829784.496748:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:8047:x1874675284070528:12345-0@lo:502: 00000100:00100000:2.0:1787829784.496979:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:8047:x1874675284070528:12345-0@lo:502: Request processed in 232us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829784.496997:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787829784.497332:0:8047:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b587bac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787829784.497353:0:8047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa44f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8047:1874675284070528:0@lo:502: 00000040:00080000:1.0:1787829784.497384:0:8047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000100:00100000:0.0:1787829784.497842:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:8047:x1874675284070400:12345-0@lo:502: Request processed in 6813us (11107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829784.497852:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000020:01000000:2.0:1787829784.498337:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787829784.498368:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787829784.498382:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b40031400/0xc03b4d103c0d7776 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d777d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829784.498396:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b40031400/0xc03b4d103c0d7776 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d777d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787829784.498409:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787829784.498413:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e9b51a3b000 from 5 10000000:01000000:2.0:1787829784.498416:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787829784.498461:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e000/0xc03b4d103c0d7784 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829784.498470:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e000/0xc03b4d103c0d7784 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829784.498481:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e000/0xc03b4d103c0d7784 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829784.498755:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f546580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284070656:0@lo:101: 00000100:00100000:2.0:1787829784.498834:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829784.498881:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fb36300 going to sleep for 11 seconds 00000100:00100000:3.0:1787829784.500241:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284070656 00000100:00100000:3.0:1787829784.500255:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284070656 00000100:00100000:3.0:1787829784.500331:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787829784.500343:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:5802:x1874675284070656:12345-0@lo:101: 00010000:00010000:3.0:1787829784.500363:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829784.500388:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b596ca400/0xc03b4d103c0d778b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d7784 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829784.500421:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b596ca400/0xc03b4d103c0d778b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d7784 expref: 17 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829784.500434:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b596ca400/0xc03b4d103c0d778b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7784 expref: 17 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829784.500443:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b596ca400, rc 0) 00000100:00100000:3.0:1787829784.500558:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284070656:12345-0@lo:101: Request processed in 210us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829784.500566:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787829784.500934:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f546580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284070656:0@lo:101: 00010000:00010000:0.0:1787829784.500959:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e000/0xc03b4d103c0d7784 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d778b expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829784.500971:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e000/0xc03b4d103c0d7784 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d778b expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829784.501108:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284070784:0@lo:256: 00000100:00100000:0.0:1787829784.501169:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829784.501210:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b42cfa0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787829784.501882:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284070784 00000100:00100000:1.0:1787829784.501890:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284070784 00000100:00100000:1.0:1787829784.501937:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787829784.501946:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284070784:12345-0@lo:256: 20000000:01000000:1.0:1787829784.501968:0:5798:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787829784.501991:0:5798:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787829784.501994:0:5798:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787829784.502164:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284070784:12345-0@lo:256: Request processed in 218us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829784.502177:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787829784.502327:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284070784:0@lo:256: 10000000:01000000:2.0:1787829784.502402:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787829784.502413:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e000/0xc03b4d103c0d7784 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d778b expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829784.502434:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e000/0xc03b4d103c0d7784 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d778b expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787829784.502445:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787829784.502448:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787829784.502452:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787829784.502484:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7792 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829784.502508:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7792 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829784.502517:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7792 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829784.502534:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f547480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284070912:0@lo:101: 00000100:00100000:2.0:1787829784.502580:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829784.502618:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fb36540 going to sleep for 11 seconds 00000100:00100000:1.0:1787829784.502829:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284070912 00000100:00100000:1.0:1787829784.502835:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284070912 00000100:00100000:1.0:1787829784.502878:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787829784.502886:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284070912:12345-0@lo:101: 00010000:00010000:1.0:1787829784.502897:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829784.502913:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d7799 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d7792 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829784.502938:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d7799 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d7792 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829784.502950:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d7799 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7792 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829784.502959:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b48cdac00, rc 0) 00000100:00100000:1.0:1787829784.502991:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284070912:12345-0@lo:101: Request processed in 106us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829784.502997:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787829784.504319:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f547480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284070912:0@lo:101: 00010000:00010000:2.0:1787829784.504352:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7792 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7799 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829784.504364:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7792 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d7799 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829784.504460:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f547480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284071040:0@lo:501: 00000100:00100000:2.0:1787829784.504561:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829784.504624:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fb36540 going to sleep for 11 seconds 00000100:00100000:1.0:1787829784.505110:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284071040 00000100:00100000:1.0:1787829784.505117:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284071040 00000100:00100000:1.0:1787829784.505185:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787829784.505194:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284071040:12345-0@lo:501: 00000100:00100000:1.0:1787829784.505583:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284071040:12345-0@lo:501: Request processed in 389us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829784.505592:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787829784.506421:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f547480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284071040:0@lo:501: 00000100:00100000:2.0:1787829784.506481:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f547480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284071168:0@lo:503: 00000100:00100000:2.0:1787829784.506765:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829784.506813:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fb36540 going to sleep for 11 seconds 00000100:00100000:1.0:1787829784.506909:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284071168 00000100:00100000:1.0:1787829784.506916:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284071168 00000100:00100000:1.0:1787829784.506978:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787829784.506986:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284071168:12345-0@lo:503: 00000100:00100000:1.0:1787829784.508383:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284071168:12345-0@lo:503: Request processed in 1386us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829784.508397:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787829784.509812:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f547480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284071168:0@lo:503: 00000100:00100000:0.0:1787829784.511011:0:8048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8048:1874675284071296:0@lo:502: 00000100:00100000:0.0:1787829784.511177:0:8048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829784.511238:0:8048:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b42cfad80 going to sleep for 11 seconds 00000100:00100000:3.0:1787829784.511411:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284071296 00000100:00100000:3.0:1787829784.511420:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284071296 00000100:00100000:3.0:1787829784.511487:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787829784.511507:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:8048:x1874675284071296:12345-0@lo:502: 00000100:00100000:3.0:1787829784.512267:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:8048:x1874675284071296:12345-0@lo:502: Request processed in 766us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829784.512280:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787829784.512490:0:8048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8048:1874675284071296:0@lo:502: 00000020:01000000:0.0:1787829784.512754:0:8048:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787829784.512765:0:8048:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787829784.512775:0:8048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787829784.512778:0:8048:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787829784.512789:0:8048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787829784.512793:0:8048:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.151@tcp to nid 0x20000c0a8c997 (192.168.201.151@tcp) 00000020:01000000:0.0:1787829784.512824:0:8048:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787829784.512828:0:8048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787829784.512860:0:8048:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e9b74bf3370) 00000020:00000080:0.0:1787829784.512890:0:8048:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787829784.512898:0:8048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787829784.513004:0:8048:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787829784.513011:0:8048:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787829784.513261:0:8048:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc03b4d103c0d77a7 00010000:00080000:1.0:1787829784.513807:0:8048:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e9b75db0000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.151@tcp at head 00010000:00010000:1.0:1787829784.514301:0:8048:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1787829784.514965:0:8048:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1787829784.514985:0:8048:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787829784.516058:0:8048:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787829784.516338:0:8048:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787829784.516399:0:8048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1787829784.516475:0:8048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1787829784.517417:0:8049:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787829784.517423:0:8049:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787829784.522857:0:8048:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787829784.522879:0:8048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787829784.522940:0:8048:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787829784.522971:0:8048:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc03b4d103c0d77ae 00000100:00080000:1.0:1787829784.522986:0:8048:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787829784.522994:0:8048:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e9b75db0000 using connection 192.168.201.151@tcp/0@lo 00000100:00100000:1.0:1787829784.523077:0:8048:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b7fa44f00 x1874675284071424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787829784.523118:0:8048:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787829784.523209:0:8048:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787829784.523214:0:8048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787829784.523216:0:8048:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787829784.523219:0:8048:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787829784.523224:0:8048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787829784.523232:0:8048:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787829784.523237:0:8048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787829784.523239:0:8048:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787829784.523280:0:8048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa46940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8048:1874675284071552:0@lo:502: 00000100:00100000:1.0:1787829784.523390:0:8048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829784.523447:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284071552 00000100:00100000:1.0:1787829784.523456:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284071552 00000100:00100000:1.0:1787829784.523513:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787829784.523524:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:8048:x1874675284071552:12345-0@lo:502: 00000100:00100000:1.0:1787829784.523817:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:8048:x1874675284071552:12345-0@lo:502: Request processed in 294us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829784.523825:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787829784.523881:0:8048:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fb65a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787829784.523905:0:8048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa46940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8048:1874675284071552:0@lo:502: 00000020:01000000:1.0:1787829784.523933:0:8048:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787829784.523937:0:8048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787829784.523939:0:8048:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787829784.523943:0:8048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:0.0:1787829784.524354:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787829784.524369:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874675284071680:0@lo:400: 00000100:00100000:0.0:1787829784.524410:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829784.524445:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284071808:0@lo:400: 00000100:00100000:0.0:1787829784.524471:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829784.524492:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787829784.524498:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284071936:0@lo:400: 00000100:00100000:0.0:1787829784.524524:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829784.524559:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284071680 00000100:00100000:0.0:1787829784.524564:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284071680 00000100:00100000:0.0:1787829784.524600:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284071808 00000100:00100000:0.0:1787829784.524602:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284071808 00000100:00100000:0.0:1787829784.524640:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284071936 00000100:00100000:0.0:1787829784.524643:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284071936 00000100:00100000:0.0:1787829784.524661:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787829784.524683:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ebde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874675284071680:12345-0@lo:400: 00000100:00100000:0.0:1787829784.524730:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ebde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874675284071680:12345-0@lo:400: Request processed in 62us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829784.524737:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787829784.524750:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787829784.524757:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ebf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284071808:12345-0@lo:400: 00000100:00100000:0.0:1787829784.524787:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ebf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284071808:12345-0@lo:400: Request processed in 31us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829784.524792:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787829784.524804:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787829784.524810:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ebda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1874675284071936:12345-0@lo:400: 00000100:00100000:0.0:1787829784.524836:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ebda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1874675284071936:12345-0@lo:400: Request processed in 27us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829784.524841:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1787829784.524867:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787829784.524891:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b48ebfc00 x1874675284071680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787829800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829784.524906:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874675284071680:0@lo:400: 00010000:00080000:0.0:1787829784.524931:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b48ebf0c0 x1874675284071936/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787829800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829784.524940:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284071936:0@lo:400: 00010000:00080000:0.0:1787829784.524948:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b48ebe580 x1874675284071808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787829800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829784.524970:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284071808:0@lo:400: 00000100:00100000:2.0:1787829784.525382:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1874675284071424:0@lo:8: 00000100:00100000:2.0:1787829784.525430:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1787829784.525488:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1787829784.525528:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787829784.525542:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7792 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7799 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829784.525563:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7792 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7799 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787829784.525582:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787829784.525585:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e9b4f8419b8 from 1 10000000:01000000:2.0:1787829784.525589:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787829784.525621:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d77b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829784.525629:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d77b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829784.525639:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d77b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829784.525655:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f546d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284072064:0@lo:101: 00000100:00100000:2.0:1787829784.525709:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829784.525726:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fb36f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787829784.525743:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284072064 00000100:00100000:2.0:1787829784.525748:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284072064 00000100:00100000:2.0:1787829784.525782:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787829784.525789:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284072064:12345-0@lo:101: 00010000:00010000:2.0:1787829784.525801:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829784.525816:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b4164fa00/0xc03b4d103c0d77bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d77b5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829784.525843:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b4164fa00/0xc03b4d103c0d77bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d77b5 expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829784.525856:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b4164fa00/0xc03b4d103c0d77bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d77b5 expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829784.525866:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164fa00, rc 0) 00000100:00100000:2.0:1787829784.525899:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:5802:x1874675284072064:12345-0@lo:101: Request processed in 110us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829784.525906:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787829784.525949:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f546d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284072064:0@lo:101: 00010000:00010000:2.0:1787829784.525962:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d77b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d77bc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829784.525972:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d77b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d77bc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829784.526058:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f546d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284072192:0@lo:501: 00000100:00100000:2.0:1787829784.526104:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829784.526118:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fb36f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787829784.526128:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284072192 00000100:00100000:2.0:1787829784.526142:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284072192 00000100:00100000:2.0:1787829784.526162:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787829784.526168:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:5802:x1874675284072192:12345-0@lo:501: 00000100:00100000:2.0:1787829784.526471:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:5802:x1874675284072192:12345-0@lo:501: Request processed in 301us (365us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787829784.526478:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787829784.526512:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f546d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284072192:0@lo:501: 10000000:01000000:2.0:1787829784.526532:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787829784.526539:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d77b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d77bc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829784.526547:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d77b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d77bc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829784.527455:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284071424 00000100:00100000:0.0:1787829784.527467:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284071424 00000100:00100000:0.0:1787829784.527514:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787829784.527521:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3277:x1874675284071424:12345-0@lo:8: 00010000:00080000:0.0:1787829784.527564:0:6651:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:0.0:1787829784.527601:0:6651:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc03b4d103c0d77c3 00002000:00100000:0.0:1787829784.527620:0:6651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e9b6f92a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113940 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787829784.527625:0:6651:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1787829784.527629:0:6651:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787829784.527957:0:6651:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787829784.528279:0:6651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787829784.528317:0:6651:0:(import.c:65:import_set_state_nolock()) ffff9e9b6f928000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787829784.528425:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3277:x1874675284071424:12345-0@lo:8: Request processed in 902us (2992us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829784.528435:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787829784.528861:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7fa44f00 x1874675284071424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787829794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829784.528875:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787829784.528887:0:3277:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787829784.528897:0:3277:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787829784.528905:0:3277:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787829784.528907:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9e9b75db0000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787829784.528929:0:3277:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787829784.528935:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1874675284071424:0@lo:8: 00000004:00080000:0.0:1787829784.529381:0:8049:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787829784.529804:0:8049:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 164430785464ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787829784.576635:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284072320:0@lo:13: 00000100:00100000:0.0:1787829784.576744:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787829784.576799:0:8050:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787829784.576825:0:8050:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebfc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8050:1874675284072448:0@lo:7: 00000100:00100000:0.0:1787829784.576880:0:8050:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829784.576899:0:8050:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b42cfac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787829784.577214:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284072448 00000100:00100000:3.0:1787829784.577224:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284072448 00000100:00100000:1.0:1787829784.577357:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284072320 00000100:00100000:1.0:1787829784.577370:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284072320 00000100:00100000:1.0:1787829784.577423:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787829784.577434:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1874675284072320:12345-0@lo:13: 00002000:00000024:1.0:1787829784.577477:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787829784.577631:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1874675284072320:12345-0@lo:13: Request processed in 198us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829784.577641:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787829784.577704:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b48ebe580 x1874675284072320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829784.577728:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284072320:0@lo:13: 00000100:00100000:3.0:1787829784.577835:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787829784.577844:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f382d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8050:x1874675284072448:12345-0@lo:7: 00000100:00080000:0.0:1787829784.581348:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1787829784.587963:0:6652:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1787829784.587974:0:6652:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787829784.588435:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f382d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8050:x1874675284072448:12345-0@lo:7: Request processed in 10586us (11547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829784.588449:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787829784.588638:0:8050:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b48ebfc00 x1874675284072448/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787829800 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829784.588658:0:8050:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebfc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8050:1874675284072448:0@lo:7: 00000004:00080000:3.0:1787829784.588677:0:8050:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787829784.588730:0:8050:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b59691a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8050:1874675284072576:0@lo:5: 00000100:00100000:3.0:1787829784.588779:0:8050:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829784.588825:0:8050:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b431ba000 going to sleep for 11 seconds 00000100:00100000:0.0:1787829784.589071:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284072576 00000100:00100000:0.0:1787829784.589079:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284072576 00000100:00100000:0.0:1787829784.589293:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787829784.589304:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b59690f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8050:x1874675284072576:12345-0@lo:5: 00002000:00080000:0.0:1787829784.589338:0:6650:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787829784.589342:0:6650:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787829784.589791:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b59690f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8050:x1874675284072576:12345-0@lo:5: Request processed in 489us (1012us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787829784.589800:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787829784.589839:0:8050:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b59691a40 x1874675284072576/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787829800 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829784.589853:0:8050:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b59691a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8050:1874675284072576:0@lo:5: 00000004:00080000:0.0:1787829784.589867:0:8050:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787829784.589902:0:8050:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f380780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8050:1874675284072704:0@lo:700: 00000100:00100000:0.0:1787829784.589934:0:8050:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829784.589962:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284072704 00000100:00100000:0.0:1787829784.589966:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284072704 00000100:00100000:0.0:1787829784.589992:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787829784.589999:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8050:x1874675284072704:12345-0@lo:700: 00000100:00100000:0.0:1787829784.590057:0:6658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f381e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6658:1874675284072832:0@lo:700: 00000100:00100000:0.0:1787829784.590284:0:6658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829784.590315:0:6658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b42cfaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787829784.590333:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284072832 00000100:00100000:0.0:1787829784.590336:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284072832 00000100:00100000:0.0:1787829784.590363:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787829784.590369:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6658:x1874675284072832:12345-0@lo:700: 00000100:00100000:0.0:1787829784.590898:0:8050:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b42cfab40 going to sleep for 11 seconds 00000004:00080000:3.0:1787829784.625909:0:5827:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:1.0:1787829784.679393:0:5811:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1787829784.686943:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6658:x1874675284072832:12345-0@lo:700: Request processed in 96561us (96847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829784.686968:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787829784.687809:0:6658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f381e00 x1874675284072832/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787829800 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829784.687831:0:6658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f381e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6658:1874675284072832:0@lo:700: 40000000:02000000:0.0:1787829784.687850:0:6658:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:1.0:1787829784.812591:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8050:x1874675284072704:12345-0@lo:700: Request processed in 222578us (222642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829784.812610:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787829784.812837:0:8050:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f380780 x1874675284072704/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787829800 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829784.812857:0:8050:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f380780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8050:1874675284072704:0@lo:700: 00000001:00080000:0.0:1787829784.814401:0:7602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1787829784.814424:0:7602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:3.0:1787829784.912219:0:8050:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1787829784.918063:0:8050:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b596921c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8050:1874675284072960:0@lo:5: 00000100:00100000:3.0:1787829784.918246:0:8050:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829784.918305:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284072960 00000100:00100000:3.0:1787829784.918314:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284072960 00000100:00100000:3.0:1787829784.918380:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787829784.918393:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b59693c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8050:x1874675284072960:12345-0@lo:5: 00000100:00100000:2.0:1787829784.923331:0:8050:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b42cfab40 going to sleep for 11 seconds 00002000:00080000:3.0:1787829784.943920:0:6652:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787829784.943952:0:6652:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1787829784.948078:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b59693c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8050:x1874675284072960:12345-0@lo:5: Request processed in 29677us (29822us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787829784.948095:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787829784.948316:0:8050:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b596921c0 x1874675284072960/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787829800 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829784.948333:0:8050:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787829784.948354:0:8050:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9e9b596921c0 x1874675284072960/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787829800 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829784.948366:0:8050:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b596921c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8050:1874675284072960:0@lo:5: 00000004:00080000:2.0:1787829784.948384:0:8050:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1787829785.252581:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829786.278110:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787829786.964277:0:7602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1787829787.299510:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787829787.581556:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829787.581985:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275661440 00000100:00100000:0.0:1787829787.581998:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275661440 00000100:00100000:1.0:1787829787.582176:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 112 00000100:00100000:1.0:1787829787.582189:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2359:x1874675275661440:12345-192.168.201.51@tcp:250: 00010000:00080000:1.0:1787829787.582235:0:5800:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 9aaccd34-1037-4ac9-aa31-e92ce8889520@192.168.201.51@tcp t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:1.0:1787829787.582283:0:5800:0:(genops.c:1385:class_connect()) connect: client 9aaccd34-1037-4ac9-aa31-e92ce8889520, cookie 0xc03b4d103c0d77ca 00000100:00080000:1.0:1787829787.582471:0:5800:0:(import.c:65:import_set_state_nolock()) ffff9e9b7f523800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787829787.582580:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+5:2359:x1874675275661440:12345-192.168.201.51@tcp:250: Request processed in 391us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829787.582589:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 112 00000100:00100000:3.0:1787829787.602209:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829787.602269:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275661568 00000100:00100000:3.0:1787829787.602283:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275661568 00000100:00100000:3.0:1787829787.602354:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 113 00000100:00100000:3.0:1787829787.602367:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+5:5586:x1874675275661568:12345-192.168.201.51@tcp:101: 00010000:00010000:3.0:1787829787.602391:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829787.602413:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b596ca600/0xc03b4d103c0d77d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x53172783628c8643 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829787.602450:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b596ca600/0xc03b4d103c0d77d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8643 expref: 6 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829787.602462:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b596ca600/0xc03b4d103c0d77d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8643 expref: 6 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829787.602473:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b596ca600, rc 0) 00000100:00100000:3.0:1787829787.602542:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+6:5586:x1874675275661568:12345-192.168.201.51@tcp:101: Request processed in 178us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829787.602550:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 113 00000100:00100000:0.0:1787829787.619406:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829787.620648:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275661696 00000100:00100000:3.0:1787829787.620663:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275661696 00000100:00100000:3.0:1787829787.620738:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 114 00000100:00100000:3.0:1787829787.620765:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+6:5586:x1874675275661696:12345-192.168.201.51@tcp:501: 00000100:00100000:3.0:1787829787.621217:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+6:5586:x1874675275661696:12345-192.168.201.51@tcp:501: Request processed in 452us (1826us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787829787.621226:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 114 00000100:00100000:1.0:1787829787.628201:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829787.628544:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275661824 00000100:00100000:3.0:1787829787.628559:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275661824 00000100:00100000:3.0:1787829787.628620:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 115 00000100:00100000:3.0:1787829787.628630:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+6:5586:x1874675275661824:12345-192.168.201.51@tcp:101: 00010000:00010000:3.0:1787829787.628647:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829787.628665:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b596caa00/0xc03b4d103c0d77d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x53172783628c864a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829787.628695:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b596caa00/0xc03b4d103c0d77d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c864a expref: 7 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829787.628707:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b596caa00/0xc03b4d103c0d77d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c864a expref: 7 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829787.628716:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b596caa00, rc 0) 00000100:00100000:3.0:1787829787.628786:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+7:5586:x1874675275661824:12345-192.168.201.51@tcp:101: Request processed in 158us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829787.628795:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 115 00000100:00100000:3.0:1787829787.653832:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829787.653995:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275661952 00000100:00100000:1.0:1787829787.654012:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275661952 00000100:00100000:1.0:1787829787.654177:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 116 00000100:00100000:1.0:1787829787.654193:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+7:5586:x1874675275661952:12345-192.168.201.51@tcp:501: 00000100:00100000:1.0:1787829787.654630:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+8:5586:x1874675275661952:12345-192.168.201.51@tcp:501: Request processed in 441us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829787.654640:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 116 00000100:00100000:0.0:1787829787.662541:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829787.662680:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275662080 00000100:00100000:2.0:1787829787.662698:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275662080 00000100:00100000:2.0:1787829787.662781:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 117 00000100:00100000:2.0:1787829787.662792:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+8:5586:x1874675275662080:12345-192.168.201.51@tcp:503: 00000100:00100000:2.0:1787829787.663258:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+8:5586:x1874675275662080:12345-192.168.201.51@tcp:503: Request processed in 467us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829787.663268:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 117 00000100:00100000:0.0:1787829787.669772:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829787.672110:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275662208 00000100:00100000:2.0:1787829787.672125:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275662208 00000100:00100000:2.0:1787829787.672193:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 118 00000100:00100000:2.0:1787829787.672204:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+8:5606:x1874675275662208:12345-192.168.201.51@tcp:502: 00000100:00100000:3.0:1787829787.674800:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+8:5606:x1874675275662208:12345-192.168.201.51@tcp:502: Request processed in 2578us (5023us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829787.674819:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 118 00000100:00100000:0.0:1787829787.719725:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829787.719848:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275662336 00000100:00100000:2.0:1787829787.719861:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275662336 00000100:00100000:2.0:1787829787.719935:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 119 00000100:00100000:2.0:1787829787.719947:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+8:5606:x1874675275662336:12345-192.168.201.51@tcp:502: 00000100:00100000:2.0:1787829787.720361:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+8:5606:x1874675275662336:12345-192.168.201.51@tcp:502: Request processed in 413us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829787.720371:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 119 00000100:00100000:0.0:1787829787.732171:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829787.732409:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275662464 00000100:00100000:3.0:1787829787.732431:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275662464 00000100:00100000:3.0:1787829787.732492:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 120 00000100:00100000:3.0:1787829787.732502:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+8:5586:x1874675275662464:12345-192.168.201.51@tcp:101: 00010000:00010000:3.0:1787829787.732521:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829787.732539:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b596ca200/0xc03b4d103c0d77df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x53172783628c8674 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829787.732566:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b596ca200/0xc03b4d103c0d77df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8674 expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829787.732578:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b596ca200/0xc03b4d103c0d77df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8674 expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829787.732587:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b596ca200, rc 0) 00000100:00100000:3.0:1787829787.732647:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+9:5586:x1874675275662464:12345-192.168.201.51@tcp:101: Request processed in 147us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829787.732655:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 120 00000100:00100000:3.0:1787829787.739354:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829787.739589:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275662592 00000100:00100000:2.0:1787829787.739606:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275662592 00000100:00100000:2.0:1787829787.739705:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 121 00000100:00100000:2.0:1787829787.739717:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+9:5586:x1874675275662592:12345-192.168.201.51@tcp:256: 20000000:01000000:2.0:1787829787.739752:0:5800:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787829787.739784:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787829787.739789:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787829787.739793:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787829787.739795:0:5800:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787829787.744138:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+9:5586:x1874675275662592:12345-192.168.201.51@tcp:256: Request processed in 4411us (4780us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829787.744155:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 121 00000100:00100000:0.0:1787829787.758199:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829787.758522:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275662720 00000100:00100000:2.0:1787829787.758535:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275662720 00000100:00100000:2.0:1787829787.758601:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 122 00000100:00100000:2.0:1787829787.758616:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+9:5586:x1874675275662720:12345-192.168.201.51@tcp:101: 00010000:00010000:2.0:1787829787.758638:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829787.758663:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b4164e200/0xc03b4d103c0d77e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x53172783628c867b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829787.758700:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b4164e200/0xc03b4d103c0d77e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c867b expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829787.758714:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b4164e200/0xc03b4d103c0d77e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c867b expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829787.758725:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164e200, rc 0) 00000100:00100000:2.0:1787829787.758805:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:5586:x1874675275662720:12345-192.168.201.51@tcp:101: Request processed in 195us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829787.758814:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 122 00000100:00100000:0.0:1787829787.763255:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829787.763364:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275662848 00000100:00100000:3.0:1787829787.763376:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275662848 00000100:00100000:3.0:1787829787.763448:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 123 00000100:00100000:3.0:1787829787.763459:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69c97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:5586:x1874675275662848:12345-192.168.201.51@tcp:501: 00000100:00100000:3.0:1787829787.763857:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69c97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:5586:x1874675275662848:12345-192.168.201.51@tcp:501: Request processed in 399us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829787.763867:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 123 00000100:00100000:0.0:1787829787.769919:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829787.773776:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275662976 00000100:00100000:3.0:1787829787.774254:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275662976 00000100:00100000:1.0:1787829787.774821:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 124 00000100:00100000:1.0:1787829787.774835:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69c95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:5586:x1874675275662976:12345-192.168.201.51@tcp:503: 00000100:00100000:1.0:1787829787.775394:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69c95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:5586:x1874675275662976:12345-192.168.201.51@tcp:503: Request processed in 558us (5487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829787.775405:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 124 00000100:00100000:3.0:1787829787.786293:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829787.788780:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275663104 00000100:00100000:2.0:1787829787.788803:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275663104 00000100:00100000:2.0:1787829787.788880:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 125 00000100:00100000:2.0:1787829787.788890:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:5610:x1874675275663104:12345-192.168.201.51@tcp:502: 00000100:00100000:2.0:1787829787.792069:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:5610:x1874675275663104:12345-192.168.201.51@tcp:502: Request processed in 3163us (5775us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829787.792100:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 125 00000100:00100000:0.0:1787829787.800711:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829787.804164:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275663232 00000100:00100000:3.0:1787829787.804180:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275663232 00000100:00100000:3.0:1787829787.804266:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 126 00000100:00100000:3.0:1787829787.804277:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69c95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:5610:x1874675275663232:12345-192.168.201.51@tcp:502: 00000100:00100000:3.0:1787829787.804652:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69c95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:5610:x1874675275663232:12345-192.168.201.51@tcp:502: Request processed in 374us (3953us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829787.804664:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 126 00000100:00100000:1.0:1787829787.812223:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829787.812316:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275663360 00000100:00100000:3.0:1787829787.812325:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275663360 00000100:00100000:3.0:1787829787.812374:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 4 00000100:00100000:3.0:1787829787.812381:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2359:x1874675275663360:12345-192.168.201.51@tcp:38: 00010000:00080000:3.0:1787829787.812423:0:5804:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from b6abf229-545c-43fd-8dee-d9adf582be48@192.168.201.51@tcp t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:3.0:1787829787.812479:0:5804:0:(genops.c:1385:class_connect()) connect: client b6abf229-545c-43fd-8dee-d9adf582be48, cookie 0xc03b4d103c0d77ed 00000004:00100000:3.0:1787829787.812511:0:5804:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000001:00000004:3.0:1787829787.812518:0:5804:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1787829787.886511:0:5804:0:(import.c:65:import_set_state_nolock()) ffff9e9b52056000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787829787.886599:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+6:2359:x1874675275663360:12345-192.168.201.51@tcp:38: Request processed in 74216us (74393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829787.886612:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 4 00010000:00010000:0.0:1787829788.326784:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787829788.662544:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829788.662657:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275663488 00000100:00100000:0.0:1787829788.662667:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275663488 00000100:00100000:0.0:1787829788.662753:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 5 00000100:00100000:0.0:1787829788.662763:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b59692d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:0:x1874675275663488:12345-192.168.201.51@tcp:41: 00000004:00000024:0.0:1787829788.662806:0:5806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:1.0:1787829788.662950:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787829788.663699:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b59692d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:0:x1874675275663488:12345-192.168.201.51@tcp:41: Request processed in 253us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829788.663934:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 5 00000100:00100000:1.0:1787829788.664301:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829788.664702:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275663616 00000100:00100000:0.0:1787829788.664710:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275663616 00000100:00100000:0.0:1787829788.664756:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 6 00000100:00100000:0.0:1787829788.664766:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+6:5586:x1874675275663616:12345-192.168.201.51@tcp:41: 00000004:00000024:0.0:1787829788.664790:0:7257:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787829788.665000:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+6:5586:x1874675275663616:12345-192.168.201.51@tcp:41: Request processed in 236us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829788.665008:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 6 00000100:00100000:1.0:1787829788.684950:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829788.685354:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275663744 00000100:00100000:0.0:1787829788.685364:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275663744 00000100:00100000:0.0:1787829788.685430:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 7 00000100:00100000:0.0:1787829788.685441:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:5586:x1874675275663744:12345-192.168.201.51@tcp:40: 00000100:00100000:0.0:1787829788.685542:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:5586:x1874675275663744:12345-192.168.201.51@tcp:40: Request processed in 102us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829788.685549:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 7 00000100:00100000:1.0:1787829788.688175:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829788.688218:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829788.691374:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829788.691441:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829788.691978:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275664128 00000100:00100000:3.0:1787829788.691986:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275664128 00000100:00100000:3.0:1787829788.692168:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 0 00000100:00100000:3.0:1787829788.692180:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+6:5586:x1874675275664128:12345-192.168.201.51@tcp:33: 00000100:00100000:3.0:1787829788.692313:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275664256 00000100:00100000:3.0:1787829788.692317:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275664256 00000100:00100000:3.0:1787829788.692345:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 127 00000100:00100000:3.0:1787829788.692351:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2360:x1874675275664256:12345-192.168.201.51@tcp:400: 00000100:00100000:3.0:1787829788.692414:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2360:x1874675275664256:12345-192.168.201.51@tcp:400: Request processed in 63us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829788.692422:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 127 00000100:00100000:2.0:1787829788.697771:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275663872 00000100:00100000:2.0:1787829788.697785:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275663872 00000100:00100000:2.0:1787829788.697823:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275664000 00000100:00100000:2.0:1787829788.697833:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275664000 00000100:00100000:2.0:1787829788.697852:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 8 00000100:00100000:2.0:1787829788.697861:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2359:x1874675275663872:12345-192.168.201.51@tcp:8: 00010000:00080000:2.0:1787829788.697891:0:6650:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b6abf229-545c-43fd-8dee-d9adf582be48@192.168.201.51@tcp t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:2.0:1787829788.697921:0:6650:0:(genops.c:1385:class_connect()) connect: client b6abf229-545c-43fd-8dee-d9adf582be48, cookie 0xc03b4d103c0d77f4 00002000:00100000:2.0:1787829788.697931:0:6650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b6abf229-545c-43fd-8dee-d9adf582be48/ffff9e9b75da2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787829788.697957:0:6650:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:2.0:1787829788.698408:0:6650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787829788.698443:0:6650:0:(import.c:65:import_set_state_nolock()) ffff9e9b75da2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787829788.698509:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+6:2359:x1874675275663872:12345-192.168.201.51@tcp:8: Request processed in 647us (10343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829788.698518:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 8 00000100:00100000:2.0:1787829788.698537:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 9 00000100:00100000:2.0:1787829788.698542:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2359:x1874675275664000:12345-192.168.201.51@tcp:8: 00010000:00080000:2.0:1787829788.698557:0:6650:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b6abf229-545c-43fd-8dee-d9adf582be48@192.168.201.51@tcp t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:2.0:1787829788.698575:0:6650:0:(genops.c:1385:class_connect()) connect: client b6abf229-545c-43fd-8dee-d9adf582be48, cookie 0xc03b4d103c0d77fb 00002000:00100000:2.0:1787829788.698581:0:6650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b6abf229-545c-43fd-8dee-d9adf582be48/ffff9e9b75da0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787829788.698596:0:6650:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:2.0:1787829788.701910:0:6650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787829788.701958:0:6650:0:(import.c:65:import_set_state_nolock()) ffff9e9b75da4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787829788.702260:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+6:2359:x1874675275664000:12345-192.168.201.51@tcp:8: Request processed in 3714us (14038us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829788.702272:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 9 00000004:00080000:0.0:1787829788.731177:0:5807:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 38905us 00000004:00200000:3.0:1787829788.768997:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787829788.769207:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+6:5586:x1874675275664128:12345-192.168.201.51@tcp:33: Request processed in 77024us (77838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829788.769219:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 0 00000100:00100000:1.0:1787829789.108979:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829789.109133:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275664384 00000100:00100000:3.0:1787829789.109144:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275664384 00000100:00100000:3.0:1787829789.109254:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 8 00000100:00100000:3.0:1787829789.109266:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+6:5627:x1874675275664384:12345-192.168.201.51@tcp:101: 00010000:00010000:3.0:1787829789.109295:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829789.109334:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cbe00/0xc03b4d103c0d7802 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c86a5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829789.109413:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596ca000/0xc03b4d103c0d7809 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829789.109428:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596ca000/0xc03b4d103c0d7809 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829789.109443:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596ca000/0xc03b4d103c0d7809 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829789.109770:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787829789.109775:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787829789.109852:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596ca000/0xc03b4d103c0d7809 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829789.109882:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cbe00/0xc03b4d103c0d7802 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c86a5 expref: 8 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829789.109899:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596ca000/0xc03b4d103c0d7809 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c86a5 expref: 7 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829789.109909:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b478cc600) 00010000:00010000:3.0:1787829789.109913:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787829789.109916:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b596ca000, rc 0) 00000100:00100000:3.0:1787829789.109985:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+7:5627:x1874675275664384:12345-192.168.201.51@tcp:101: Request processed in 721us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829789.109994:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 8 00010000:00010000:0.0:1787829789.346298:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829789.538446:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787829789.538472:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284073088:0@lo:13: 00000100:00100000:0.0:1787829789.538557:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829789.538648:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284073088 00000100:00100000:0.0:1787829789.538656:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284073088 00000100:00100000:0.0:1787829789.538713:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787829789.538722:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284073088:12345-0@lo:13: 00002000:00000024:0.0:1787829789.538763:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787829789.538811:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284073088:12345-0@lo:13: Request processed in 90us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829789.538819:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787829789.538845:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787829789.538879:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7fa470c0 x1874675284073088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829789.538897:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284073088:0@lo:13: 00000100:00100000:1.0:1787829789.539735:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874675284073344:0@lo:400: 00000100:00100000:1.0:1787829789.539784:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829789.539813:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787829789.539818:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284073216:0@lo:400: 00000100:00100000:1.0:1787829789.539859:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829789.539883:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284073728:0@lo:400: 00000100:00100000:1.0:1787829789.539908:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829789.539936:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284073344 00000100:00100000:1.0:1787829789.539941:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284073344 00000100:00100000:1.0:1787829789.539976:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787829789.539983:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1874675284073344:12345-0@lo:400: 00000100:00100000:1.0:1787829789.540059:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1874675284073344:12345-0@lo:400: Request processed in 76us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829789.540066:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787829789.540085:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284073728 00000100:00100000:1.0:1787829789.540088:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284073728 00000100:00100000:1.0:1787829789.540119:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787829789.540125:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284073728:12345-0@lo:400: 00000100:00100000:1.0:1787829789.540156:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284073728:12345-0@lo:400: Request processed in 32us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829789.540162:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787829789.540193:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787829789.540218:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7fa470c0 x1874675284073728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829789.540227:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787829789.540242:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284073728:0@lo:400: 00000100:00100000:1.0:1787829789.540254:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874675284073344:0@lo:400: 00000100:00100000:1.0:1787829789.540271:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284073472:0@lo:400: 00000100:00100000:1.0:1787829789.540294:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829789.540322:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787829789.540329:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1874675284073600:0@lo:400: 00000100:00100000:1.0:1787829789.540365:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829789.540387:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284073472 00000100:00100000:1.0:1787829789.540390:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284073472 00000100:00100000:1.0:1787829789.540414:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284073600 00000100:00100000:1.0:1787829789.540418:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284073600 00000100:00100000:1.0:1787829789.540435:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787829789.540441:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284073472:12345-0@lo:400: 00000100:00100000:1.0:1787829789.540476:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284073472:12345-0@lo:400: Request processed in 35us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829789.540482:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787829789.540661:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787829789.540670:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874675284073600:12345-0@lo:400: 00000100:00100000:1.0:1787829789.540702:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874675284073600:12345-0@lo:400: Request processed in 34us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829789.540708:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787829789.540725:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787829789.540743:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1874675284073600:0@lo:400: 00000100:00100000:1.0:1787829789.540753:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284073472:0@lo:400: 00000100:00100000:3.0:1787829789.542295:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284073216 00000100:00100000:3.0:1787829789.542305:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284073216 00000100:00100000:3.0:1787829789.542354:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787829789.542364:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3279:x1874675284073216:12345-0@lo:400: 00000100:00100000:3.0:1787829789.542438:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3279:x1874675284073216:12345-0@lo:400: Request processed in 76us (2578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829789.542445:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787829789.543638:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284073216:0@lo:400: 00000001:00100000:2.0:1787829789.621426:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b6abf229-545c-43fd-8dee-d9adf582be48 00000100:00100000:3.0:1787829790.050371:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787829790.050396:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f545e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284073856:0@lo:13: 00000100:00100000:3.0:1787829790.050472:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829790.050626:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284073856 00000100:00100000:2.0:1787829790.050638:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284073856 00000100:00100000:2.0:1787829790.050682:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787829790.050689:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b59691a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284073856:12345-0@lo:13: 00002000:00000024:2.0:1787829790.050709:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787829790.050746:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b59691a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284073856:12345-0@lo:13: Request processed in 58us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829790.050751:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787829790.050867:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f545e00 x1874675284073856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829790.050882:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f545e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284073856:0@lo:13: 00010000:00010000:0.0:1787829790.370423:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829791.394198:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787829791.601416:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829791.601902:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275664512 00000100:00100000:1.0:1787829791.601916:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275664512 00000100:00100000:1.0:1787829791.602076:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 9 00000100:00100000:1.0:1787829791.602091:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f5452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+7:5679:x1874675275664512:12345-192.168.201.51@tcp:41: 00000004:00000024:1.0:1787829791.602155:0:7257:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:2.0:1787829791.602354:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787829791.602502:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f5452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+7:5679:x1874675275664512:12345-192.168.201.51@tcp:41: Request processed in 414us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829791.602512:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 9 00000100:00100000:1.0:1787829791.615195:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829791.615486:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275664640 00000100:00100000:2.0:1787829791.615501:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275664640 00000100:00100000:2.0:1787829791.615615:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 9 00000100:00100000:2.0:1787829791.615628:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b6abf229-545c-43fd-8dee-d9adf582be48+5:5679:x1874675275664640:12345-192.168.201.51@tcp:13: 00002000:00000024:2.0:1787829791.615698:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787829791.615784:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b6abf229-545c-43fd-8dee-d9adf582be48+5:5679:x1874675275664640:12345-192.168.201.51@tcp:13: Request processed in 159us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829791.615794:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 9 00000100:00080000:1.0:1787829791.616392:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787829791.632912:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829791.633157:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275664768 00000100:00100000:2.0:1787829791.633173:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275664768 00000100:00100000:2.0:1787829791.633268:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 10 00000100:00100000:2.0:1787829791.633281:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f380000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b6abf229-545c-43fd-8dee-d9adf582be48+6:5679:x1874675275664768:12345-192.168.201.51@tcp:13: 00002000:00000024:2.0:1787829791.633337:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787829791.633428:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f380000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b6abf229-545c-43fd-8dee-d9adf582be48+6:5679:x1874675275664768:12345-192.168.201.51@tcp:13: Request processed in 150us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829791.633437:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 10 00000100:00080000:1.0:1787829791.633514:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787829792.418679:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787829793.214625:0:5827:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b6abf229-545c-43fd-8dee-d9adf582be48 00010000:00010000:0.0:1787829793.442464:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787829793.722953:0:7602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b6abf229-545c-43fd-8dee-d9adf582be48 00000100:00100000:0.0:1787829794.115221:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829794.115260:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829794.115292:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829794.115322:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829794.115354:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275665280 00000100:00100000:0.0:1787829794.115366:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275665280 00000100:00100000:0.0:1787829794.115441:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275665152 00000100:00100000:0.0:1787829794.115445:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275665152 00000100:00100000:0.0:1787829794.115468:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 2 00000100:00100000:0.0:1787829794.115480:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f381680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+5:2363:x1874675275665280:12345-192.168.201.51@tcp:400: 00000100:00100000:0.0:1787829794.115585:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f381680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+5:2363:x1874675275665280:12345-192.168.201.51@tcp:400: Request processed in 107us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829794.115593:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 2 00000100:00100000:0.0:1787829794.115614:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 3 00000100:00100000:0.0:1787829794.115641:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f382940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+5:2362:x1874675275665152:12345-192.168.201.51@tcp:400: 00000100:00100000:0.0:1787829794.115669:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f382940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+5:2362:x1874675275665152:12345-192.168.201.51@tcp:400: Request processed in 30us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829794.115676:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 3 00000100:00100000:0.0:1787829794.115840:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275665024 00000100:00100000:0.0:1787829794.115844:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275665024 00000100:00100000:0.0:1787829794.116067:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 20 00000100:00100000:0.0:1787829794.116075:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f380f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:2363:x1874675275665024:12345-192.168.201.51@tcp:400: 00000100:00100000:0.0:1787829794.116115:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f380f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:2363:x1874675275665024:12345-192.168.201.51@tcp:400: Request processed in 41us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829794.116121:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 20 00000100:00080000:0.0:1787829794.116170:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787829794.116176:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787829794.116178:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787829794.116379:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275664896 00000100:00100000:3.0:1787829794.116385:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275664896 00000100:00100000:3.0:1787829794.116464:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 129 00000100:00100000:3.0:1787829794.116473:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2362:x1874675275664896:12345-192.168.201.51@tcp:400: 00000100:00100000:3.0:1787829794.116580:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2362:x1874675275664896:12345-192.168.201.51@tcp:400: Request processed in 108us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829794.116588:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 129 00010000:00010000:0.0:1787829794.468547:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829794.658299:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284073984:0@lo:13: 00000100:00100000:0.0:1787829794.658372:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829794.659158:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284073984 00000100:00100000:1.0:1787829794.659167:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284073984 00000100:00100000:1.0:1787829794.659235:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787829794.659244:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f383840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284073984:12345-0@lo:13: 00002000:00000024:1.0:1787829794.659278:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787829794.659336:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f383840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284073984:12345-0@lo:13: Request processed in 93us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829794.659343:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1787829794.659400:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787829794.659432:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7fa47480 x1874675284073984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829794.659453:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284073984:0@lo:13: 00000100:00100000:3.0:1787829794.661065:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787829794.661082:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b596921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284074112:0@lo:400: 00000100:00100000:3.0:1787829794.661139:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829794.661207:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5455a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284074240:0@lo:400: 00000100:00100000:3.0:1787829794.661234:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829794.661268:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284074240 00000100:00100000:3.0:1787829794.661274:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284074240 00000100:00100000:3.0:1787829794.661315:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787829794.661324:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5455a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284074240:12345-0@lo:400: 00000100:00100000:3.0:1787829794.661366:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5455a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284074240:12345-0@lo:400: Request processed in 44us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829794.661372:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787829794.661412:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5455a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284074240:0@lo:400: 00000100:00100000:3.0:1787829794.661444:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5455a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1874675284074368:0@lo:400: 00000100:00100000:3.0:1787829794.661490:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829794.661543:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284074368 00000100:00100000:3.0:1787829794.661547:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284074368 00000100:00100000:3.0:1787829794.661579:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787829794.661585:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1874675284074368:12345-0@lo:400: 00000100:00100000:3.0:1787829794.661620:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1874675284074368:12345-0@lo:400: Request processed in 35us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829794.661626:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1787829794.661647:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787829794.661666:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5455a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1874675284074368:0@lo:400: 00000100:00100000:3.0:1787829794.661696:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1874675284074496:0@lo:400: 00000100:00100000:3.0:1787829794.661723:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829794.661746:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284074496 00000100:00100000:3.0:1787829794.661750:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284074496 00000100:00100000:3.0:1787829794.661776:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787829794.661782:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874675284074496:12345-0@lo:400: 00000100:00100000:3.0:1787829794.661815:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874675284074496:12345-0@lo:400: Request processed in 33us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829794.661821:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1787829794.661837:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787829794.661853:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1874675284074496:0@lo:400: 00000100:00100000:3.0:1787829794.661882:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787829794.661889:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284074624:0@lo:400: 00000100:00100000:3.0:1787829794.661914:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829794.661940:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284074624 00000100:00100000:3.0:1787829794.661944:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284074624 00000100:00100000:3.0:1787829794.661988:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787829794.661995:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284074624:12345-0@lo:400: 00000100:00100000:3.0:1787829794.662065:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284074624:12345-0@lo:400: Request processed in 70us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829794.662071:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787829794.662089:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787829794.662106:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b6fa4ed00 x1874675284074624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829794.662116:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284074624:0@lo:400: 00000100:00100000:2.0:1787829794.662501:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284074112 00000100:00100000:2.0:1787829794.662513:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284074112 00000100:00100000:2.0:1787829794.662544:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787829794.662552:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3280:x1874675284074112:12345-0@lo:400: 00000100:00100000:2.0:1787829794.662597:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3280:x1874675284074112:12345-0@lo:400: Request processed in 46us (1458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829794.662604:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787829794.662646:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b596921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284074112:0@lo:400: 00000001:02000400:1.0:1787829794.896135:0:8256:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1787829795.170447:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284074752:0@lo:13: 00000100:00100000:1.0:1787829795.170730:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829795.171464:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284074752 00000100:00100000:1.0:1787829795.171827:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284074752 00000100:00100000:1.0:1787829795.175304:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787829795.175339:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284074752:12345-0@lo:13: 00002000:00000024:1.0:1787829795.175399:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787829795.180471:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284074752:12345-0@lo:13: Request processed in 5137us (9726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829795.180509:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1787829795.181258:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b6fa4de00 x1874675284074752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829795.181306:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284074752:0@lo:13: 00010000:00010000:0.0:1787829795.495355:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829796.519065:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829797.538576:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829798.562287:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787829799.194910:0:8404:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff89af5ad0 20000000:00000080:3.0:1787829799.194929:0:8404:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e9b5390cc00 uarg=0000000000000000 20000000:01000000:3.0:1787829799.194980:0:8404:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1787829799.194982:0:8404:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1787829799.194985:0:8404:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787829799.194990:0:8404:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787829799.194995:0:8404:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1787829799.195010:0:8404:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787829799.195012:0:8404:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787829799.195385:0:8404:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787829799.195389:0:8404:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787829799.196324:0:8405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1787829799.196906:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1787829799.196977:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1787829799.197341:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1787829799.197358:0:8404:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787829799.197361:0:8404:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787829799.198285:0:8406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1787829799.198789:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1787829799.198829:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1787829799.198870:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1787829799.198902:0:8404:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787829799.198904:0:8404:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787829799.200105:0:8407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1787829799.200449:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1787829799.200511:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1787829799.200552:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1787829799.200564:0:8404:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787829799.200566:0:8404:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787829799.201297:0:8408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1787829799.201625:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1787829799.201661:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1787829799.201691:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:1.0:1787829799.201707:0:8404:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787829799.201726:0:8404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e9b48cdb200/0xc03b4d103c0d7810 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.201744:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b596cae00/0xc03b4d103c0d770d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7706 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.201752:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b48cda800/0xc03b4d103c0d7737 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7730 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.201759:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b596ca800/0xc03b4d103c0d7761 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d775a expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.201766:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b40031800/0xc03b4d103c0d776f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7768 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.201773:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b48cda200/0xc03b4d103c0d777d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7776 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.201779:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d7799 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7792 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.201797:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b4164fa00/0xc03b4d103c0d77bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d77b5 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.201807:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b596ca600/0xc03b4d103c0d77d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8643 expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.201814:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b596caa00/0xc03b4d103c0d77d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c864a expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.201822:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e9b48cdb200/0xc03b4d103c0d7810 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.201858:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b596caa00/0xc03b4d103c0d77d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c864a expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.201883:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9b596caa00/0xc03b4d103c0d77d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c864a expref: 9 pid: 5798 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829799.201899:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874675284074880:192.168.201.51@tcp:104: 00010000:00010000:1.0:1787829799.202350:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b596ca600/0xc03b4d103c0d77d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8643 expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.202360:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9b596ca600/0xc03b4d103c0d77d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8643 expref: 9 pid: 5799 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829799.202369:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa47480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874675284075008:192.168.201.51@tcp:104: 00000100:00100000:0.0:1787829799.202556:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829799.202911:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829799.202934:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829799.202953:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829799.202984:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275665408 00000100:00100000:0.0:1787829799.202990:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275665408 00000100:00100000:0.0:1787829799.203052:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 131 00000100:00100000:0.0:1787829799.203061:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2360:x1874675275665408:12345-192.168.201.51@tcp:400: 00000100:00100000:0.0:1787829799.203105:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2360:x1874675275665408:12345-192.168.201.51@tcp:400: Request processed in 46us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829799.203113:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 131 00000100:00100000:0.0:1787829799.203139:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275665792 00000100:00100000:0.0:1787829799.203142:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275665792 00000100:00100000:0.0:1787829799.203168:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275665664 00000100:00100000:0.0:1787829799.203170:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275665664 00000100:00100000:0.0:1787829799.203183:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 5 00000100:00100000:0.0:1787829799.203189:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f381a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+5:2361:x1874675275665792:12345-192.168.201.51@tcp:400: 00000100:00100000:0.0:1787829799.203211:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f381a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+5:2361:x1874675275665792:12345-192.168.201.51@tcp:400: Request processed in 23us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829799.203218:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 5 00000100:00100000:0.0:1787829799.203227:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 6 00000100:00100000:0.0:1787829799.203232:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f383480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+5:2360:x1874675275665664:12345-192.168.201.51@tcp:400: 00000100:00100000:0.0:1787829799.203249:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f383480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+5:2360:x1874675275665664:12345-192.168.201.51@tcp:400: Request processed in 17us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829799.203254:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 6 00010000:00010000:1.0:1787829799.203533:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b4164fa00/0xc03b4d103c0d77bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d77b5 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.203557:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e9b4164fa00/0xc03b4d103c0d77bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d77b5 expref: 18 pid: 5800 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829799.203567:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874675284075136:0@lo:104: 00000100:00100000:1.0:1787829799.203599:0:8404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787829799.203628:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d7799 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d7792 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.203636:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d7799 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d7792 expref: 18 pid: 5800 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829799.203644:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874675284075264:0@lo:104: 00000100:00100000:1.0:1787829799.203666:0:8404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829799.203697:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787829799.203708:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284075136 00000100:00100000:1.0:1787829799.203712:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284075136 00000100:00100000:1.0:1787829799.203733:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284075264 00000100:00100000:1.0:1787829799.203736:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284075264 00000100:00100000:1.0:1787829799.203748:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787829799.203754:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+4:8404:x1874675284075136:12345-0@lo:104: 00010000:00010000:1.0:1787829799.203767:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d77b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d77bc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.203807:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787829799.203812:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+4:8404:x1874675284075136:12345-0@lo:104: Request processed in 59us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829799.203817:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787829799.203829:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787829799.203841:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:8404:x1874675284075264:12345-0@lo:104: 00010000:00010000:1.0:1787829799.203848:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7792 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d7799 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.203889:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787829799.203894:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:8404:x1874675284075264:12345-0@lo:104: Request processed in 55us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829799.203900:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1787829799.203937:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787829799.203943:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d77b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d77bc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.203949:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164e800 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:1.0:1787829799.203953:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d77b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d77bc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.203962:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d77b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d77bc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787829799.203970:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d77b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d77bc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787829799.203975:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787829799.204004:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d77b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d77bc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204010:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787829799.204041:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d77b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d77bc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204059:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e800/0xc03b4d103c0d77b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d77bc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204072:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787829799.204075:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7792 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d7799 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204081:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164ea00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:1.0:1787829799.204085:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7792 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d7799 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204091:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7792 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d7799 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787829799.204097:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7792 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d7799 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787829799.204102:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787829799.204114:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7792 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7799 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204120:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787829799.204132:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7792 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7799 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204139:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b4164ea00/0xc03b4d103c0d7792 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7799 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204146:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829799.204152:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829799.204153:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829799.204170:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b48cda200/0xc03b4d103c0d777d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d7776 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204179:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e9b48cda200/0xc03b4d103c0d777d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d7776 expref: 18 pid: 5798 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829799.204188:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874675284075648:0@lo:104: 00000100:00100000:1.0:1787829799.204209:0:8404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829799.204226:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284075648 00000100:00100000:1.0:1787829799.204229:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284075648 00000100:00100000:1.0:1787829799.204244:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787829799.204249:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:8404:x1874675284075648:12345-0@lo:104: 00010000:00010000:1.0:1787829799.204256:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b40031400/0xc03b4d103c0d7776 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d777d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204281:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787829799.204285:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:8404:x1874675284075648:12345-0@lo:104: Request processed in 37us (76us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829799.204291:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1787829799.204301:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787829799.204304:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b40031400/0xc03b4d103c0d7776 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d777d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204310:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40031400 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:1.0:1787829799.204313:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b40031400/0xc03b4d103c0d7776 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d777d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204320:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b40031400/0xc03b4d103c0d7776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d777d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787829799.204332:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b40031400/0xc03b4d103c0d7776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d777d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787829799.204337:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787829799.204352:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b40031400/0xc03b4d103c0d7776 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d777d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204358:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787829799.204363:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b40031400/0xc03b4d103c0d7776 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d777d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204370:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b40031400/0xc03b4d103c0d7776 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d777d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204379:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829799.204380:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829799.204382:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829799.204396:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b40031800/0xc03b4d103c0d776f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d7768 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204404:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e9b40031800/0xc03b4d103c0d776f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d7768 expref: 18 pid: 5799 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829799.204419:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874675284075904:0@lo:104: 00000100:00100000:1.0:1787829799.204440:0:8404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829799.204458:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284075904 00000100:00100000:1.0:1787829799.204461:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284075904 00000100:00100000:1.0:1787829799.204480:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787829799.204486:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ebc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:8404:x1874675284075904:12345-0@lo:104: 00010000:00010000:1.0:1787829799.204501:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d776f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204530:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787829799.204534:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ebc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:8404:x1874675284075904:12345-0@lo:104: Request processed in 49us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829799.204540:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1787829799.204552:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787829799.204556:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d776f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204562:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b48cda600 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:1.0:1787829799.204565:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d776f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204572:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d776f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787829799.204578:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d776f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787829799.204583:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787829799.204608:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7768 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d776f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204614:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787829799.204620:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7768 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d776f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204627:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7768 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d776f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204640:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829799.204642:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829799.204643:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829799.204658:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b596ca800/0xc03b4d103c0d7761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d775a expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204666:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e9b596ca800/0xc03b4d103c0d7761 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d775a expref: 18 pid: 5799 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829799.204674:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c3840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874675284076160:0@lo:104: 00000100:00100000:1.0:1787829799.204698:0:8404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829799.204717:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284076160 00000100:00100000:1.0:1787829799.204720:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284076160 00000100:00100000:1.0:1787829799.204737:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787829799.204742:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:8404:x1874675284076160:12345-0@lo:104: 00010000:00010000:1.0:1787829799.204750:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d775a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d7761 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204777:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787829799.204781:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:8404:x1874675284076160:12345-0@lo:104: Request processed in 39us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829799.204787:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1787829799.204798:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787829799.204801:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d775a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d7761 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204807:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40031e00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:1.0:1787829799.204811:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d775a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d7761 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204822:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d775a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d7761 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787829799.204829:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d775a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d7761 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787829799.204834:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787829799.204846:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d775a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7761 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204851:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787829799.204856:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d775a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7761 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204862:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d775a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7761 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204870:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829799.204872:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829799.204884:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829799.204900:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b48cda800/0xc03b4d103c0d7737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d7730 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.204908:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e9b48cda800/0xc03b4d103c0d7737 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d7730 expref: 18 pid: 5799 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829799.204917:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c2580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874675284076416:0@lo:104: 00000100:00100000:1.0:1787829799.204937:0:8404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829799.204952:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284076416 00000100:00100000:1.0:1787829799.204959:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284076416 00000100:00100000:1.0:1787829799.204974:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787829799.204979:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:8404:x1874675284076416:12345-0@lo:104: 00010000:00010000:1.0:1787829799.204986:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7730 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d7737 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.205011:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787829799.205034:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:8404:x1874675284076416:12345-0@lo:104: Request processed in 37us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829799.205039:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1787829799.205051:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787829799.205055:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7730 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d7737 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.205061:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b48cda000 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:1.0:1787829799.205064:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7730 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d7737 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.205071:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d7737 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787829799.205078:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d7737 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787829799.205084:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787829799.205095:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7730 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7737 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.205101:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787829799.205105:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7730 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7737 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.205116:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7730 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7737 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.205125:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829799.205126:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829799.205128:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829799.205141:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b596cae00/0xc03b4d103c0d770d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d7706 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.205149:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e9b596cae00/0xc03b4d103c0d770d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d7706 expref: 18 pid: 5799 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829799.205158:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c0b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874675284076672:0@lo:104: 00000100:00100000:1.0:1787829799.205177:0:8404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829799.205192:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284076672 00000100:00100000:1.0:1787829799.205194:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284076672 00000100:00100000:1.0:1787829799.205210:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787829799.205214:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:8404:x1874675284076672:12345-0@lo:104: 00010000:00010000:1.0:1787829799.205221:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f000/0xc03b4d103c0d7706 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d770d expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.205245:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787829799.205250:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:8404:x1874675284076672:12345-0@lo:104: Request processed in 35us (72us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829799.205255:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787829799.205265:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787829799.205268:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f000/0xc03b4d103c0d7706 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d770d expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.205283:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164f000 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:1.0:1787829799.205286:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f000/0xc03b4d103c0d7706 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d770d expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.205294:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f000/0xc03b4d103c0d7706 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d770d expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787829799.205300:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f000/0xc03b4d103c0d7706 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d770d expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787829799.205305:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787829799.205317:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f000/0xc03b4d103c0d7706 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d770d expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.205322:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787829799.205326:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f000/0xc03b4d103c0d7706 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d770d expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.205331:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b4164f000/0xc03b4d103c0d7706 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d770d expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.205344:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829799.205346:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829799.205347:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829799.205358:0:8404:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b603cd300 going to sleep for 11 seconds 00000100:00100000:1.0:1787829799.205379:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874675284075136:0@lo:104: 00000100:00100000:1.0:1787829799.205387:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874675284075264:0@lo:104: 00000100:00100000:1.0:1787829799.205393:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874675284075648:0@lo:104: 00000100:00100000:1.0:1787829799.205407:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874675284075904:0@lo:104: 00000100:00100000:1.0:1787829799.205414:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c3840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874675284076160:0@lo:104: 00000100:00100000:1.0:1787829799.205420:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c2580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874675284076416:0@lo:104: 00000100:00100000:1.0:1787829799.205426:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c0b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874675284076672:0@lo:104: 00000100:00100000:3.0:1787829799.205676:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275665536 00000100:00100000:3.0:1787829799.205682:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275665536 00000100:00100000:3.0:1787829799.205787:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 24 00000100:00100000:3.0:1787829799.205796:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f382580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:2361:x1874675275665536:12345-192.168.201.51@tcp:400: 00000100:00100000:3.0:1787829799.205845:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f382580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:2361:x1874675275665536:12345-192.168.201.51@tcp:400: Request processed in 51us (3290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829799.205851:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 24 00000100:00100000:3.0:1787829799.205886:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284075392:0@lo:103: 00000100:00100000:3.0:1787829799.205917:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829799.205959:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284076288:0@lo:103: 00000100:00100000:3.0:1787829799.205978:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829799.205997:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787829799.206002:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284076032:0@lo:103: 00000100:00100000:3.0:1787829799.206044:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829799.206081:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284075392 00000100:00100000:3.0:1787829799.206084:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284075392 00010000:00010000:3.0:1787829799.206101:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b4164fa00/0xc03b4d103c0d77bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d77b5 expref: 19 pid: 5800 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829799.206115:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284076288 00000100:00100000:3.0:1787829799.206117:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284076288 00010000:00010000:3.0:1787829799.206127:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b596ca800/0xc03b4d103c0d7761 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d775a expref: 20 pid: 5799 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829799.206136:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284076032 00000100:00100000:3.0:1787829799.206145:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284076032 00010000:00010000:3.0:1787829799.206159:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b40031800/0xc03b4d103c0d776f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d7768 expref: 21 pid: 5799 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829799.206171:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787829799.206177:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+21:3279:x1874675284075392:12345-0@lo:103: 00010000:00010000:3.0:1787829799.206187:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829799.206191:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b4164fa00/0xc03b4d103c0d77bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d77b5 expref: 21 pid: 5800 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829799.206200:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b4164fa00/0xc03b4d103c0d77bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d77b5 expref: 21 pid: 5800 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829799.206214:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b4164fa00/0xc03b4d103c0d77bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d77b5 expref: 21 pid: 5800 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829799.206228:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787829799.206256:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+20:3279:x1874675284075392:12345-0@lo:103: Request processed in 79us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829799.206263:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787829799.206276:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787829799.206281:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3279:x1874675284076288:12345-0@lo:103: 00010000:00010000:3.0:1787829799.206288:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829799.206292:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b596ca800/0xc03b4d103c0d7761 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d775a expref: 19 pid: 5799 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829799.206302:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b596ca800/0xc03b4d103c0d7761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d775a expref: 19 pid: 5799 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829799.206311:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b596ca800/0xc03b4d103c0d7761 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d775a expref: 19 pid: 5799 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829799.206326:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787829799.206350:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:3279:x1874675284076288:12345-0@lo:103: Request processed in 68us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829799.206356:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787829799.206369:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787829799.206376:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:3279:x1874675284076032:12345-0@lo:103: 00010000:00010000:3.0:1787829799.206382:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829799.206387:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b40031800/0xc03b4d103c0d776f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d7768 expref: 17 pid: 5799 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829799.206394:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b40031800/0xc03b4d103c0d776f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d7768 expref: 17 pid: 5799 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829799.206404:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b40031800/0xc03b4d103c0d776f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d7768 expref: 17 pid: 5799 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829799.206412:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787829799.206433:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:3279:x1874675284076032:12345-0@lo:103: Request processed in 58us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829799.206439:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787829799.206465:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284076032:0@lo:103: 00000100:00100000:3.0:1787829799.206473:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284075392:0@lo:103: 00000100:00100000:3.0:1787829799.206479:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284076288:0@lo:103: 00000100:00080000:0.0:1787829799.206796:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787829799.206802:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787829799.206805:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787829799.206819:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787829799.207188:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874675284074880:192.168.201.51@tcp:104: 00000100:00100000:0.0:1787829799.207506:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829799.207859:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275665920 00000100:00100000:3.0:1787829799.207872:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275665920 00010000:00010000:3.0:1787829799.207905:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b596caa00/0xc03b4d103c0d77d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c864a expref: 10 pid: 5798 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829799.207969:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 15 00000100:00100000:3.0:1787829799.207977:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f380b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2363:x1874675275665920:12345-192.168.201.51@tcp:103: 00010000:00010000:3.0:1787829799.207990:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829799.207995:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b596caa00/0xc03b4d103c0d77d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c864a expref: 10 pid: 5798 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829799.208006:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b596caa00/0xc03b4d103c0d77d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c864a expref: 10 pid: 5798 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829799.208079:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b596caa00/0xc03b4d103c0d77d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c864a expref: 10 pid: 5798 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829799.208092:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787829799.208187:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284075520:0@lo:103: 00000100:00100000:2.0:1787829799.208222:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829799.208248:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284076544:0@lo:103: 00000100:00100000:2.0:1787829799.208265:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829799.208275:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787829799.208280:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284075776:0@lo:103: 00000100:00100000:2.0:1787829799.208297:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829799.208303:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284076800:0@lo:103: 00000100:00100000:2.0:1787829799.208317:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829799.208335:0:5792:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787829799.208342:0:5792:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1787829799.208502:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f380b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aaccd34-1037-4ac9-aa31-e92ce8889520+9:2363:x1874675275665920:12345-192.168.201.51@tcp:103: Request processed in 525us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829799.208510:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 15 00000100:00100000:3.0:1787829799.208537:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284075520 00000100:00100000:3.0:1787829799.208541:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284075520 00010000:00010000:3.0:1787829799.208555:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d7799 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d7792 expref: 16 pid: 5800 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829799.208567:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284076544 00000100:00100000:3.0:1787829799.208569:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284076544 00010000:00010000:3.0:1787829799.208578:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b48cda800/0xc03b4d103c0d7737 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d7730 expref: 17 pid: 5799 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829799.208587:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284075776 00000100:00100000:3.0:1787829799.208594:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284075776 00010000:00010000:3.0:1787829799.208604:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b48cda200/0xc03b4d103c0d777d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d7776 expref: 18 pid: 5798 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829799.208614:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284076800 00000100:00100000:3.0:1787829799.208616:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284076800 00010000:00010000:3.0:1787829799.208623:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b596cae00/0xc03b4d103c0d770d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d7706 expref: 19 pid: 5799 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829799.208633:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787829799.208638:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f545a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3280:x1874675284075520:12345-0@lo:103: 00010000:00010000:3.0:1787829799.208645:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829799.208649:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d7799 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d7792 expref: 19 pid: 5800 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829799.208657:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d7799 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d7792 expref: 19 pid: 5800 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829799.208669:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d7799 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d7792 expref: 19 pid: 5800 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829799.208679:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787829799.208716:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f545a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:3280:x1874675284075520:12345-0@lo:103: Request processed in 76us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829799.208722:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787829799.208734:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787829799.208741:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f5461c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:3280:x1874675284076544:12345-0@lo:103: 00010000:00010000:3.0:1787829799.208748:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829799.208752:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b48cda800/0xc03b4d103c0d7737 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d7730 expref: 17 pid: 5799 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829799.208770:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b48cda800/0xc03b4d103c0d7737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d7730 expref: 17 pid: 5799 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829799.208779:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b48cda800/0xc03b4d103c0d7737 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d7730 expref: 17 pid: 5799 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829799.208788:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787829799.208811:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f5461c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:3280:x1874675284076544:12345-0@lo:103: Request processed in 72us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829799.208818:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787829799.208831:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787829799.208837:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b51a07450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:3280:x1874675284075776:12345-0@lo:103: 00010000:00010000:3.0:1787829799.208845:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829799.208850:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b48cda200/0xc03b4d103c0d777d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d7776 expref: 15 pid: 5798 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829799.208857:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b48cda200/0xc03b4d103c0d777d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d7776 expref: 15 pid: 5798 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829799.208866:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b48cda200/0xc03b4d103c0d777d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d7776 expref: 15 pid: 5798 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829799.208884:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787829799.208905:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b51a07450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:3280:x1874675284075776:12345-0@lo:103: Request processed in 69us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829799.208911:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787829799.208944:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787829799.208949:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f547c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:3280:x1874675284076800:12345-0@lo:103: 00010000:00010000:3.0:1787829799.208960:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829799.208965:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b596cae00/0xc03b4d103c0d770d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d7706 expref: 13 pid: 5799 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829799.208973:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b596cae00/0xc03b4d103c0d770d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d7706 expref: 13 pid: 5799 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829799.208983:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b596cae00/0xc03b4d103c0d770d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d7706 expref: 13 pid: 5799 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829799.208991:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787829799.209009:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f547c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:3280:x1874675284076800:12345-0@lo:103: Request processed in 61us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829799.209063:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787829799.209699:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284075776:0@lo:103: 00000100:00100000:2.0:1787829799.209708:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284076800:0@lo:103: 00000100:00100000:2.0:1787829799.209715:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284075520:0@lo:103: 00000100:00100000:2.0:1787829799.209722:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284076544:0@lo:103: 00000100:00100000:3.0:1787829799.210704:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa47480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874675284075008:192.168.201.51@tcp:104: 00010000:00010000:3.0:1787829799.210744:0:8404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e9b48cdb200/0xc03b4d103c0d7810 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829799.212981:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829799.213080:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275666048 00000100:00100000:3.0:1787829799.213089:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275666048 00010000:00010000:0.0:1787829799.213150:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b596ca600/0xc03b4d103c0d77d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8643 expref: 9 pid: 5799 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829799.213194:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 20 00000100:00100000:0.0:1787829799.213201:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aaccd34-1037-4ac9-aa31-e92ce8889520+9:2362:x1874675275666048:12345-192.168.201.51@tcp:103: 00010000:00010000:0.0:1787829799.213213:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829799.213217:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b596ca600/0xc03b4d103c0d77d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8643 expref: 9 pid: 5799 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829799.213226:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b596ca600/0xc03b4d103c0d77d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8643 expref: 9 pid: 5799 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829799.213239:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b596ca600/0xc03b4d103c0d77d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8643 expref: 9 pid: 5799 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829799.213252:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e9b48cdb200/0xc03b4d103c0d7810 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829799.213258:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b48cdb200/0xc03b4d103c0d7810 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829799.213270:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b48cdb200/0xc03b4d103c0d7810 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829799.213277:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b48cdb200/0xc03b4d103c0d7810 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829799.213284:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e9b48cdb200/0xc03b4d103c0d7810 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829799.213290:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e9b48cdb200/0xc03b4d103c0d7810 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829799.213305:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b48cdb200 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787829799.213309:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e9b48cdb200/0xc03b4d103c0d7810 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829799.213318:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e9b48cdb200/0xc03b4d103c0d7810 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829799.213339:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e9b48cdb200/0xc03b4d103c0d7810 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829799.213349:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829799.213408:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aaccd34-1037-4ac9-aa31-e92ce8889520+8:2362:x1874675275666048:12345-192.168.201.51@tcp:103: Request processed in 205us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829799.213425:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 20 00010000:00010000:3.0:1787829799.213613:0:8404:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e9b48cdb200/0xc03b4d103c0d7810 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829799.213623:0:8404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e9b48cdb200/0xc03b4d103c0d7810 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829799.213629:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b48cdb200/0xc03b4d103c0d7810 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829799.586317:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829799.778339:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284076928:0@lo:13: 00000100:00100000:1.0:1787829799.778409:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829799.778503:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284076928 00000100:00100000:1.0:1787829799.778511:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284076928 00000100:00100000:1.0:1787829799.778567:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787829799.778576:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284076928:12345-0@lo:13: 00000100:00080000:0.0:1787829799.778581:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787829799.778609:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787829799.778662:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284076928:12345-0@lo:13: Request processed in 86us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829799.778669:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787829799.778692:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f4c1e00 x1874675284076928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829815 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829799.778711:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284076928:0@lo:13: 00000100:00100000:3.0:1787829799.779234:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874675284077056:0@lo:400: 00000100:00100000:3.0:1787829799.779279:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829799.779290:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f380b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284077184:0@lo:400: 00000100:00100000:3.0:1787829799.779301:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787829799.779306:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f381e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284077440:0@lo:400: 00000100:00100000:3.0:1787829799.779326:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829799.779326:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829799.779357:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284077056 00000100:00100000:3.0:1787829799.779361:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284077056 00000100:00100000:2.0:1787829799.779365:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787829799.779371:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f383c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1874675284077312:0@lo:400: 00000100:00100000:3.0:1787829799.779387:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284077184 00000100:00100000:3.0:1787829799.779389:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284077184 00000100:00100000:2.0:1787829799.779392:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829799.779407:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284077312 00000100:00100000:3.0:1787829799.779410:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284077312 00000100:00100000:0.0:1787829799.779494:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284077440 00000100:00100000:0.0:1787829799.779498:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284077440 00000100:00100000:0.0:1787829799.779526:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787829799.779534:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284077440:12345-0@lo:400: 00000100:00100000:0.0:1787829799.779576:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284077440:12345-0@lo:400: Request processed in 43us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829799.779588:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787829799.779618:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787829799.779621:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787829799.779672:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787829799.779682:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1874675284077056:12345-0@lo:400: 00000100:00100000:2.0:1787829799.779715:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1874675284077056:12345-0@lo:400: Request processed in 36us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829799.779722:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787829799.779739:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787829799.779744:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284077184:12345-0@lo:400: 00000100:00100000:2.0:1787829799.779786:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284077184:12345-0@lo:400: Request processed in 42us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829799.779792:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787829799.779804:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787829799.779809:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f546580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874675284077312:12345-0@lo:400: 00000100:00100000:2.0:1787829799.779836:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f546580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874675284077312:12345-0@lo:400: Request processed in 27us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829799.779841:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1787829799.779956:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f381e00 x1874675284077440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829799.779967:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f381e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284077440:0@lo:400: 00000100:00100000:2.0:1787829799.779977:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874675284077056:0@lo:400: 00000100:00100000:0.0:1787829799.780390:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f383c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1874675284077312:0@lo:400: 00000100:00100000:0.0:1787829799.780400:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f380b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284077184:0@lo:400: 00000100:00100000:1.0:1787829800.290359:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787829800.294577:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284077568:0@lo:13: 00000100:00100000:1.0:1787829800.294654:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829800.294874:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284077568 00000100:00100000:0.0:1787829800.294883:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284077568 00000100:00100000:0.0:1787829800.294932:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787829800.294941:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284077568:12345-0@lo:13: 00002000:00000024:0.0:1787829800.294980:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787829800.295055:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284077568:12345-0@lo:13: Request processed in 115us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829800.295063:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1787829800.295645:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b6fa4c3c0 x1874675284077568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829800.295676:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284077568:0@lo:13: 10000000:01000000:0.0:1787829800.610159:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787829800.610167:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e9b7f524800 from 39 10000000:01000000:0.0:1787829800.610172:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787829800.610223:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b40030c00/0xc03b4d103c0d7817 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829800.610235:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b40030c00/0xc03b4d103c0d7817 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829800.610246:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b40030c00/0xc03b4d103c0d7817 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829800.610270:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f380b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284077696:0@lo:101: 00000100:00100000:0.0:1787829800.610340:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829800.610402:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b44d203c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787829800.610780:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284077696 00000100:00100000:2.0:1787829800.610787:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284077696 00000100:00100000:2.0:1787829800.610843:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787829800.610862:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+12:5802:x1874675284077696:12345-0@lo:101: 00010000:00010000:2.0:1787829800.610890:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829800.610905:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b4164f000/0xc03b4d103c0d781e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d7817 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829800.610928:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b4164f000/0xc03b4d103c0d781e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d7817 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829800.610938:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b4164f000/0xc03b4d103c0d781e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7817 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829800.610946:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164f000, rc 0) 00000100:00100000:2.0:1787829800.611007:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:5802:x1874675284077696:12345-0@lo:101: Request processed in 155us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829800.611045:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00010000:00010000:0.0:1787829800.611273:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829800.611348:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f380b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284077696:0@lo:101: 00010000:00010000:1.0:1787829800.611364:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b40030c00/0xc03b4d103c0d7817 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d781e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829800.611384:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b40030c00/0xc03b4d103c0d7817 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d781e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829800.611444:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284077824:0@lo:501: 00000100:00100000:1.0:1787829800.611486:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829800.611555:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51011f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787829800.617375:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284077824 00000100:00100000:0.0:1787829800.617391:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284077824 00000100:00100000:0.0:1787829800.617473:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787829800.617497:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:5802:x1874675284077824:12345-0@lo:501: 00000100:00100000:0.0:1787829800.617836:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:5802:x1874675284077824:12345-0@lo:501: Request processed in 340us (6348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829800.617844:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787829800.618160:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284077824:0@lo:501: 00000100:00100000:1.0:1787829800.618208:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284077952:0@lo:503: 00000100:00100000:1.0:1787829800.618255:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829800.618294:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51011f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787829800.618429:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284077952 00000100:00100000:2.0:1787829800.618434:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284077952 00000100:00100000:2.0:1787829800.618486:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787829800.618494:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:5802:x1874675284077952:12345-0@lo:503: 00000100:00100000:2.0:1787829800.618648:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:5802:x1874675284077952:12345-0@lo:503: Request processed in 155us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829800.618655:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787829800.618810:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284077952:0@lo:503: 00000100:00100000:1.0:1787829800.619042:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8421:1874675284078080:0@lo:502: 00000100:00100000:1.0:1787829800.619080:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829800.619097:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b510113c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787829800.619184:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284078080 00000100:00100000:3.0:1787829800.619189:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284078080 00000100:00100000:3.0:1787829800.619209:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787829800.619216:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:8421:x1874675284078080:12345-0@lo:502: 00000100:00100000:3.0:1787829800.619408:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:8421:x1874675284078080:12345-0@lo:502: Request processed in 191us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829800.619417:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787829800.619779:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8421:1874675284078080:0@lo:502: 00000100:00100000:1.0:1787829800.619823:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8421:1874675284078208:0@lo:502: 00000100:00100000:1.0:1787829800.619867:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829800.619890:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b510113c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787829800.619962:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284078208 00000100:00100000:0.0:1787829800.619966:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284078208 00000100:00100000:0.0:1787829800.620001:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787829800.620008:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:8421:x1874675284078208:12345-0@lo:502: 00000100:00100000:0.0:1787829800.620176:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:8421:x1874675284078208:12345-0@lo:502: Request processed in 169us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829800.620181:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787829800.620329:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8421:1874675284078208:0@lo:502: 00000040:00080000:1.0:1787829800.620346:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787829800.620409:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787829800.620427:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787829800.620436:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b40030c00/0xc03b4d103c0d7817 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d781e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829800.620450:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b40030c00/0xc03b4d103c0d7817 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d781e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787829800.620466:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787829800.620468:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787829800.620470:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787829800.620490:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7825 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829800.620495:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7825 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829800.620501:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7825 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829800.620509:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284078336:0@lo:101: 00000100:00100000:1.0:1787829800.620528:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829800.620542:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b510113c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787829800.620929:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284078336 00000100:00100000:3.0:1787829800.620934:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284078336 00000100:00100000:3.0:1787829800.620956:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787829800.620963:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+13:5802:x1874675284078336:12345-0@lo:101: 00010000:00010000:3.0:1787829800.620974:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829800.620987:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b596cae00/0xc03b4d103c0d782c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d7825 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829800.621009:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b596cae00/0xc03b4d103c0d782c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d7825 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829800.621042:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b596cae00/0xc03b4d103c0d782c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7825 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829800.621059:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b596cae00, rc 0) 00000100:00100000:3.0:1787829800.621101:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:5802:x1874675284078336:12345-0@lo:101: Request processed in 138us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829800.621107:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787829800.621131:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284078336:0@lo:101: 00010000:00010000:1.0:1787829800.621143:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7825 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d782c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829800.623792:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7825 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d782c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829800.623917:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284078464:0@lo:501: 00000100:00100000:1.0:1787829800.623978:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829800.625993:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b510113c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787829800.628739:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284078464 00000100:00100000:3.0:1787829800.628751:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284078464 00000100:00100000:3.0:1787829800.628878:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787829800.628888:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:5802:x1874675284078464:12345-0@lo:501: 00000100:00100000:3.0:1787829800.629203:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:5802:x1874675284078464:12345-0@lo:501: Request processed in 316us (5224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829800.629212:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787829800.629818:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284078464:0@lo:501: 00000100:00100000:1.0:1787829800.629879:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284078592:0@lo:503: 00000100:00100000:1.0:1787829800.629929:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829800.629957:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b510113c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787829800.630572:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284078592 00000100:00100000:2.0:1787829800.630578:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284078592 00000100:00100000:2.0:1787829800.630611:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787829800.630618:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:5802:x1874675284078592:12345-0@lo:503: 00000100:00100000:2.0:1787829800.630810:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:5802:x1874675284078592:12345-0@lo:503: Request processed in 191us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829800.630817:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787829800.631000:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284078592:0@lo:503: 00000100:00100000:3.0:1787829800.632092:0:8422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8422:1874675284078720:0@lo:502: 00000100:00100000:3.0:1787829800.632157:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829800.632200:0:8422:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b603cd540 going to sleep for 11 seconds 00000100:00100000:2.0:1787829800.632295:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284078720 00000100:00100000:2.0:1787829800.632301:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284078720 00000100:00100000:2.0:1787829800.632343:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787829800.632350:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:8422:x1874675284078720:12345-0@lo:502: 00000100:00100000:2.0:1787829800.632556:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:8422:x1874675284078720:12345-0@lo:502: Request processed in 206us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829800.632564:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787829800.632792:0:8422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8422:1874675284078720:0@lo:502: 00000020:01000000:1.0:1787829800.632817:0:8422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787829800.632827:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787829800.632829:0:8422:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787829800.632834:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787829800.632867:0:8422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8422:1874675284078848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787829800.632902:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829800.632928:0:8422:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b510113c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787829800.633080:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284078848 00000100:00100000:3.0:1787829800.633084:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284078848 00000100:00100000:3.0:1787829800.633103:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787829800.633109:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:8422:x1874675284078848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787829800.633888:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:8422:x1874675284078848:12345-0@lo:502:llog_process_th.0 Request processed in 776us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829800.633898:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787829800.637746:0:8422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8422:1874675284078848:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787829800.637797:0:8422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787829800.637808:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787829800.637811:0:8422:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787829800.637816:0:8422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1787829800.638112:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1787829800.638138:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787829800.638149:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7825 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d782c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829800.638160:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d782c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787829800.638171:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787829800.638174:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e9b53977800 from 39 10000000:01000000:2.0:1787829800.638177:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787829800.638211:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fa00/0xc03b4d103c0d7833 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829800.638219:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fa00/0xc03b4d103c0d7833 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829800.638229:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fa00/0xc03b4d103c0d7833 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829800.638250:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f545a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284078976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787829800.638317:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829800.638393:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4548ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787829800.638530:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284078976 00000100:00100000:3.0:1787829800.638537:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284078976 00000100:00100000:3.0:1787829800.638578:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787829800.638585:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:5802:x1874675284078976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787829800.638605:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829800.638618:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b596caa00/0xc03b4d103c0d783a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d7833 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829800.638639:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b596caa00/0xc03b4d103c0d783a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d7833 expref: 15 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829800.638647:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b596caa00/0xc03b4d103c0d783a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7833 expref: 15 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829800.638655:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b596caa00, rc 0) 00000100:00100000:3.0:1787829800.638708:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:5802:x1874675284078976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829800.638714:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787829800.638914:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f545a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284078976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787829800.638928:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fa00/0xc03b4d103c0d7833 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d783a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829800.638937:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fa00/0xc03b4d103c0d7833 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d783a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829800.639003:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f545a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284079104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787829800.639066:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829800.639081:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4548ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787829800.639318:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284079104 00000100:00100000:3.0:1787829800.639323:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284079104 00000100:00100000:3.0:1787829800.639362:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787829800.639370:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:5802:x1874675284079104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787829800.639794:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:5802:x1874675284079104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 423us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829800.639801:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787829800.639958:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f545a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284079104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787829800.639990:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f545a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284079232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787829800.640072:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829800.640093:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4548ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787829800.640177:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284079232 00000100:00100000:3.0:1787829800.640181:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284079232 00000100:00100000:3.0:1787829800.640216:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787829800.640223:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:5802:x1874675284079232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787829800.640604:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:5802:x1874675284079232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 380us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829800.640622:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787829800.640897:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f545a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284079232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787829800.641346:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f545a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8423:1874675284079360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787829800.641402:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829800.641434:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4548e480 going to sleep for 11 seconds 00000100:00100000:1.0:1787829800.641589:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284079360 00000100:00100000:1.0:1787829800.641594:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284079360 00000100:00100000:1.0:1787829800.641629:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787829800.641636:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:8423:x1874675284079360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787829800.641843:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:8423:x1874675284079360:12345-0@lo:502:llog_process_th.0 Request processed in 207us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829800.641861:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787829800.642066:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f545a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8423:1874675284079360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787829800.642110:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f545a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8423:1874675284079488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787829800.642146:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829800.642177:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4548e480 going to sleep for 11 seconds 00000100:00100000:3.0:1787829800.642232:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284079488 00000100:00100000:3.0:1787829800.642237:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284079488 00000100:00100000:3.0:1787829800.642264:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787829800.642271:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:8423:x1874675284079488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787829800.642671:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:8423:x1874675284079488:12345-0@lo:502:llog_process_th.0 Request processed in 399us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829800.642679:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787829800.648073:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f545a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8423:1874675284079488:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787829800.648137:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787829800.648327:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787829800.648355:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787829800.648367:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fa00/0xc03b4d103c0d7833 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d783a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829800.648377:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fa00/0xc03b4d103c0d7833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d783a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787829800.648388:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787829800.648390:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1787829800.648393:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787829800.648440:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7841 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829800.648448:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7841 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829800.648457:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7841 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829800.648478:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284079616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787829800.648543:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829800.648585:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51011900 going to sleep for 11 seconds 00000100:00100000:0.0:1787829800.648671:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284079616 00000100:00100000:0.0:1787829800.648677:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284079616 00000100:00100000:0.0:1787829800.648766:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787829800.648777:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:5802:x1874675284079616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787829800.648790:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829800.648804:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b40031800/0xc03b4d103c0d7848 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d7841 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829800.648826:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b40031800/0xc03b4d103c0d7848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d7841 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829800.648836:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b40031800/0xc03b4d103c0d7848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7841 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829800.648844:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b40031800, rc 0) 00000100:00100000:0.0:1787829800.648905:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:5802:x1874675284079616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829800.648924:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787829800.649000:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284079616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787829800.649013:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7841 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7848 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829800.649041:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7841 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d7848 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829800.649090:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f545a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284079744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787829800.649115:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829800.654667:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4548e480 going to sleep for 11 seconds 00000100:00100000:1.0:1787829800.655755:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284079744 00000100:00100000:1.0:1787829800.655768:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284079744 00000100:00100000:1.0:1787829800.655822:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787829800.655832:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:5802:x1874675284079744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787829800.656177:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:5802:x1874675284079744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 346us (7058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829800.656185:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787829800.656213:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f545a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284079744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787829800.656262:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f545a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284079872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787829800.656309:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829800.656352:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4548e480 going to sleep for 11 seconds 00000100:00100000:1.0:1787829800.660762:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284079872 00000100:00100000:1.0:1787829800.660775:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284079872 00000100:00100000:1.0:1787829800.660833:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787829800.660843:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:5802:x1874675284079872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787829800.661138:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:5802:x1874675284079872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 296us (4827us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829800.661146:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787829800.661332:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f545a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284079872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787829800.671449:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f545a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8424:1874675284080000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787829800.671560:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829800.671611:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4548ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1787829800.671809:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284080000 00000100:00100000:1.0:1787829800.671819:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284080000 00000100:00100000:1.0:1787829800.671876:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787829800.671886:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:8424:x1874675284080000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787829800.672170:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:8424:x1874675284080000:12345-0@lo:502:llog_process_th.0 Request processed in 285us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829800.672179:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787829800.674600:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f545a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8424:1874675284080000:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787829800.674648:0:8424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787829800.674668:0:8424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787829800.674671:0:8424:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787829800.674678:0:8424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787829800.674716:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f545a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8424:1874675284080128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787829800.674791:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829800.674830:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4548ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787829800.674884:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284080128 00000100:00100000:3.0:1787829800.674891:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284080128 00000100:00100000:3.0:1787829800.674939:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787829800.674947:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:8424:x1874675284080128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787829800.675178:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:8424:x1874675284080128:12345-0@lo:502:llog_process_th.0 Request processed in 230us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829800.675186:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787829800.676664:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f545a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8424:1874675284080128:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787829800.676706:0:8424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787829800.676715:0:8424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787829800.676718:0:8424:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787829800.676722:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1787829800.676830:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1787829800.676861:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787829800.676874:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7841 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7848 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829800.676885:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7841 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7848 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787829800.676896:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787829800.676899:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e9b51a3b000 from 39 10000000:01000000:3.0:1787829800.676902:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787829800.676937:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b596ca800/0xc03b4d103c0d784f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829800.676955:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b596ca800/0xc03b4d103c0d784f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829800.676965:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b596ca800/0xc03b4d103c0d784f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829800.676983:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284080256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787829800.677060:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829800.677089:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47f4b300 going to sleep for 11 seconds 00000100:00100000:0.0:1787829800.677209:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284080256 00000100:00100000:0.0:1787829800.677217:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284080256 00000100:00100000:1.0:1787829800.677332:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787829800.677341:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:5802:x1874675284080256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787829800.677354:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829800.677367:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b48cdb000/0xc03b4d103c0d7856 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d784f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829800.677399:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b48cdb000/0xc03b4d103c0d7856 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d784f expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829800.677410:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b48cdb000/0xc03b4d103c0d7856 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d784f expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829800.677418:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b48cdb000, rc 0) 00000100:00100000:1.0:1787829800.677464:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284080256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829800.677478:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787829800.677606:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284080256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787829800.677620:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b596ca800/0xc03b4d103c0d784f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7856 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829800.677629:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b596ca800/0xc03b4d103c0d784f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d7856 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829800.677681:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f545a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284080384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787829800.684397:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829800.684482:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4548ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1787829800.684737:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284080384 00000100:00100000:1.0:1787829800.684747:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284080384 00000100:00100000:1.0:1787829800.684810:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787829800.684819:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284080384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787829800.685194:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284080384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 375us (2739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829800.685203:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787829800.685340:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f545a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284080384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787829800.685393:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f383c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284080512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787829800.685440:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829800.685472:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b44d20000 going to sleep for 11 seconds 00000100:00100000:2.0:1787829800.685519:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284080512 00000100:00100000:2.0:1787829800.685525:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284080512 00000100:00100000:2.0:1787829800.685561:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787829800.685568:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284080512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787829800.685724:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284080512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829800.685731:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787829800.687274:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f383c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284080512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787829800.688268:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8425:1874675284080640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787829800.688341:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829800.688395:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47f4b300 going to sleep for 11 seconds 00000100:00100000:2.0:1787829800.688482:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284080640 00000100:00100000:2.0:1787829800.688489:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284080640 00000100:00100000:2.0:1787829800.688537:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787829800.688546:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:8425:x1874675284080640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787829800.688817:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:8425:x1874675284080640:12345-0@lo:502:llog_process_th.0 Request processed in 272us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829800.688826:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787829800.688991:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8425:1874675284080640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787829800.689084:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8425:1874675284080768:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787829800.689123:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829800.689152:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47f4b300 going to sleep for 11 seconds 00000100:00100000:3.0:1787829800.689171:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284080768 00000100:00100000:3.0:1787829800.689176:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284080768 00000100:00100000:3.0:1787829800.689640:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787829800.689650:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:8425:x1874675284080768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787829800.689842:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:8425:x1874675284080768:12345-0@lo:502:llog_process_th.0 Request processed in 193us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829800.689863:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787829800.689938:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8425:1874675284080768:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787829800.689961:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787829800.690430:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787829800.690462:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787829800.690474:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b596ca800/0xc03b4d103c0d784f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7856 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829800.690485:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b596ca800/0xc03b4d103c0d784f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7856 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787829800.690495:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787829800.690498:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1787829800.690501:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787829800.690527:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d785d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829800.690535:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d785d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829800.690544:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d785d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829800.690573:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f383c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284080896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787829800.690610:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829800.693764:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b44d20000 going to sleep for 11 seconds 00000100:00100000:3.0:1787829800.693836:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284080896 00000100:00100000:3.0:1787829800.693845:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284080896 00000100:00100000:3.0:1787829800.693899:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787829800.693907:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284080896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787829800.693923:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829800.693950:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b596cbe00/0xc03b4d103c0d7864 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d785d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829800.693979:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b596cbe00/0xc03b4d103c0d7864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d785d expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829800.693992:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b596cbe00/0xc03b4d103c0d7864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d785d expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829800.694002:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b596cbe00, rc 0) 00000100:00100000:3.0:1787829800.694186:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284080896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 279us (3575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829800.694789:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787829800.694905:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f383c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284080896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787829800.694923:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d785d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7864 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829800.694932:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d785d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d7864 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829800.695120:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284081024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787829800.695155:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829800.695208:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b44ffa480 going to sleep for 11 seconds 00000100:00100000:2.0:1787829800.695247:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284081024 00000100:00100000:2.0:1787829800.695251:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284081024 00000100:00100000:3.0:1787829800.695321:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787829800.695327:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284081024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787829800.695779:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284081024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 450us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829800.695788:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787829800.695871:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284081024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787829800.695962:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284081152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787829800.696001:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829800.696091:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b601e09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787829800.696132:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284081152 00000100:00100000:2.0:1787829800.696136:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284081152 00000100:00100000:3.0:1787829800.696670:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787829800.696678:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284081152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787829800.696896:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284081152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 218us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829800.696909:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787829800.696988:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284081152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787829800.697670:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8426:1874675284081280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787829800.697715:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829800.697778:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b601e0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787829800.698377:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284081280 00000100:00100000:0.0:1787829800.698384:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284081280 00000100:00100000:2.0:1787829800.701944:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787829800.702080:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:8426:x1874675284081280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787829800.702384:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:8426:x1874675284081280:12345-0@lo:502:llog_process_th.0 Request processed in 425us (4667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829800.702657:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8426:1874675284081280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787829800.702696:0:8426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787829800.702707:0:8426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787829800.702709:0:8426:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787829800.702716:0:8426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787829800.702752:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f5461c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8426:1874675284081408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787829800.702825:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829800.705166:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787829800.709614:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4548ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787829800.709764:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284081408 00000100:00100000:0.0:1787829800.709776:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284081408 00000100:00100000:0.0:1787829800.709833:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787829800.709842:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:8426:x1874675284081408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787829800.710144:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:8426:x1874675284081408:12345-0@lo:502:llog_process_th.0 Request processed in 301us (7318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829800.710152:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787829800.710593:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f5461c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8426:1874675284081408:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787829800.710629:0:8426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787829800.710637:0:8426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787829800.710639:0:8426:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787829800.710644:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787829800.713378:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1787829800.713410:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787829800.713421:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d785d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7864 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829800.713433:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d785d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7864 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787829800.713444:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787829800.713446:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e9b4f8419b8 from 1 10000000:01000000:0.0:1787829800.713449:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787829800.713496:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b40031400/0xc03b4d103c0d786b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829800.713503:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b40031400/0xc03b4d103c0d786b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829800.713525:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b40031400/0xc03b4d103c0d786b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829800.713549:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f380780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284081536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787829800.713611:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829800.713663:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284081536 00000100:00100000:0.0:1787829800.713664:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b44d20c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787829800.713672:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284081536 00000100:00100000:2.0:1787829800.713724:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787829800.713734:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284081536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787829800.713746:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829800.713759:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b4164ea00/0xc03b4d103c0d7872 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d786b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829800.713783:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b4164ea00/0xc03b4d103c0d7872 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d786b expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829800.713793:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b4164ea00/0xc03b4d103c0d7872 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d786b expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829800.713802:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164ea00, rc 0) 00000100:00100000:2.0:1787829800.713863:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:5802:x1874675284081536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829800.713870:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787829800.714323:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f380780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284081536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787829800.714338:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b40031400/0xc03b4d103c0d786b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7872 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829800.714349:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b40031400/0xc03b4d103c0d786b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d7872 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829800.714401:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f380780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284081664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787829800.714430:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829800.714541:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284081664 00000100:00100000:2.0:1787829800.714546:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284081664 00000100:00100000:2.0:1787829800.714577:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787829800.714584:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:5802:x1874675284081664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787829800.714812:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:5802:x1874675284081664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (380us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787829800.714819:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787829800.714875:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b44d20c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787829800.714891:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f380780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284081664:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787829800.714910:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787829800.714916:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b40031400/0xc03b4d103c0d786b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7872 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829800.714924:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b40031400/0xc03b4d103c0d786b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7872 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829801.634996:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829802.658281:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829803.682365:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829803.807627:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829803.808526:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275666176 00000100:00100000:2.0:1787829803.808543:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275666176 00000100:00100000:2.0:1787829803.808629:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 164 00000100:00100000:2.0:1787829803.808642:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+8:5602:x1874675275666176:12345-192.168.201.51@tcp:101: 00010000:00010000:2.0:1787829803.808664:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829803.808689:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b4164e800/0xc03b4d103c0d7879 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x53172783628c86ac expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829803.808728:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b4164e800/0xc03b4d103c0d7879 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c86ac expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829803.808753:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b4164e800/0xc03b4d103c0d7879 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c86ac expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829803.808764:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164e800, rc 0) 00000100:00100000:2.0:1787829803.808855:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+9:5602:x1874675275666176:12345-192.168.201.51@tcp:101: Request processed in 215us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829803.808862:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 164 00000100:00100000:1.0:1787829803.819140:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829803.819322:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275666304 00000100:00100000:3.0:1787829803.819346:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275666304 00000100:00100000:3.0:1787829803.819424:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 165 00000100:00100000:3.0:1787829803.819436:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+9:5602:x1874675275666304:12345-192.168.201.51@tcp:501: 00000100:00100000:3.0:1787829803.819839:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+9:5602:x1874675275666304:12345-192.168.201.51@tcp:501: Request processed in 403us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829803.819849:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 165 00000100:00100000:1.0:1787829803.826176:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829803.826512:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275666432 00000100:00100000:3.0:1787829803.826535:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275666432 00000100:00100000:3.0:1787829803.826612:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 166 00000100:00100000:3.0:1787829803.826624:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+9:5602:x1874675275666432:12345-192.168.201.51@tcp:503: 00000100:00100000:3.0:1787829803.827196:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+9:5602:x1874675275666432:12345-192.168.201.51@tcp:503: Request processed in 571us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829803.827206:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 166 00000100:00100000:0.0:1787829803.840626:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829803.840806:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275666560 00000100:00100000:2.0:1787829803.840819:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275666560 00000100:00100000:2.0:1787829803.840959:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 167 00000100:00100000:2.0:1787829803.840971:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+9:6092:x1874675275666560:12345-192.168.201.51@tcp:502: 00000100:00100000:2.0:1787829803.841404:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+9:6092:x1874675275666560:12345-192.168.201.51@tcp:502: Request processed in 433us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829803.841424:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 167 00000100:00100000:2.0:1787829803.844914:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829803.845197:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275666688 00000100:00100000:1.0:1787829803.845210:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275666688 00000100:00100000:1.0:1787829803.845287:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 168 00000100:00100000:1.0:1787829803.845299:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+9:6092:x1874675275666688:12345-192.168.201.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787829803.845896:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+9:6092:x1874675275666688:12345-192.168.201.51@tcp:502:llog_process_th.0 Request processed in 596us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829803.845908:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 168 00000100:00100000:0.0:1787829803.852586:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829803.852991:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275666816 00000100:00100000:2.0:1787829803.853004:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275666816 00000100:00100000:2.0:1787829803.853126:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 169 00000100:00100000:2.0:1787829803.853138:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+9:5602:x1874675275666816:12345-192.168.201.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787829803.853170:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829803.853195:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b4164f400/0xc03b4d103c0d7880 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x53172783628c86b3 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829803.853233:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b4164f400/0xc03b4d103c0d7880 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c86b3 expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829803.853245:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b4164f400/0xc03b4d103c0d7880 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c86b3 expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829803.853259:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164f400, rc 0) 00000100:00100000:2.0:1787829803.853567:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:5602:x1874675275666816:12345-192.168.201.51@tcp:101:ll_cfg_requeue.0 Request processed in 430us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829803.853575:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 169 00000100:00100000:2.0:1787829803.863730:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829803.868814:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275666944 00000100:00100000:3.0:1787829803.868837:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275666944 00000100:00100000:1.0:1787829803.869316:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 170 00000100:00100000:1.0:1787829803.869409:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:5602:x1874675275666944:12345-192.168.201.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787829803.872423:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:5602:x1874675275666944:12345-192.168.201.51@tcp:501:ll_cfg_requeue.0 Request processed in 3077us (8754us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787829803.872442:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 170 00000100:00100000:3.0:1787829804.320259:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829804.321172:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275667072 00000100:00100000:2.0:1787829804.321187:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275667072 00000100:00100000:2.0:1787829804.321262:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 171 00000100:00100000:2.0:1787829804.321271:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2362:x1874675275667072:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829804.321377:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2362:x1874675275667072:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 105us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829804.321428:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 171 00000100:00100000:0.0:1787829804.327381:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829804.327446:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829804.327542:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829804.327702:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275667456 00000100:00100000:1.0:1787829804.327714:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275667456 00000100:00100000:1.0:1787829804.327799:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275667328 00000100:00100000:1.0:1787829804.327802:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275667328 00000100:00100000:1.0:1787829804.327823:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 8 00000100:00100000:1.0:1787829804.327836:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f383c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+5:2363:x1874675275667456:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829804.327934:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f383c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+5:2363:x1874675275667456:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 101us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829804.327942:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 8 00000100:00100000:1.0:1787829804.327962:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 9 00000100:00100000:1.0:1787829804.327969:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f380b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+5:2363:x1874675275667328:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829804.327993:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f380b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+5:2363:x1874675275667328:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 25us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829804.328000:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 9 00000100:00080000:0.0:1787829804.328162:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787829804.328167:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787829804.328232:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275667200 00000100:00100000:2.0:1787829804.328237:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275667200 00000100:00100000:2.0:1787829804.328295:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 28 00000100:00100000:2.0:1787829804.328305:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f380780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+6:2362:x1874675275667200:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829804.328339:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f380780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+6:2362:x1874675275667200:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 37us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829804.328346:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 28 00000100:00080000:0.0:1787829804.328420:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787829804.706812:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787829804.899446:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787829804.899485:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284081792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787829804.899587:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829804.899874:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284081792 00000100:00100000:1.0:1787829804.899886:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284081792 00000100:00100000:1.0:1787829804.899977:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787829804.899987:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f5461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284081792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787829804.900072:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787829804.900133:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f5461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284081792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829804.900142:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787829804.900210:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f4c1680 x1874675284081792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829820 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829804.900229:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284081792:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787829804.900891:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787829804.901589:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787829804.901619:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284081920:0@lo:400:kworker.0 00000100:00100000:0.0:1787829804.901729:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829804.903054:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284081920 00000100:00100000:1.0:1787829804.903070:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284081920 00000100:00100000:2.0:1787829804.903485:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284082048:0@lo:400:kworker.0 00000100:00100000:2.0:1787829804.903558:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829804.903636:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284082048 00000100:00100000:2.0:1787829804.903640:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284082048 00000100:00100000:2.0:1787829804.903673:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787829804.903683:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f544f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284082048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829804.903736:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f544f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284082048:12345-0@lo:400:kworker.0 Request processed in 55us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829804.903743:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787829804.905323:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284082048:0@lo:400:kworker.0 00000100:00100000:3.0:1787829804.912903:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1874675284082176:0@lo:400:kworker.0 00000100:00100000:3.0:1787829804.912977:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829804.913055:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284082176 00000100:00100000:3.0:1787829804.913062:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284082176 00000100:00100000:3.0:1787829804.913121:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787829804.913131:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1874675284082176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829804.913185:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1874675284082176:12345-0@lo:400:kworker.0 Request processed in 56us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829804.913192:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787829804.913239:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1874675284082176:0@lo:400:kworker.0 00000100:00080000:3.0:1787829804.913266:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787829804.913279:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284082432:0@lo:400:kworker.0 00000100:00100000:3.0:1787829804.913325:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829804.913348:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787829804.913354:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1874675284082304:0@lo:400:kworker.0 00000100:00100000:3.0:1787829804.913374:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829804.915417:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284082432 00000100:00100000:0.0:1787829804.915429:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284082432 00000100:00100000:0.0:1787829804.915497:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787829804.915506:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284082432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829804.915588:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284082432:12345-0@lo:400:kworker.0 Request processed in 83us (2262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829804.915595:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787829804.917136:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787829804.917158:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3280:x1874675284081920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829804.917238:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3280:x1874675284081920:12345-0@lo:400:kworker.0 Request processed in 91us (15510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829804.917246:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787829804.917324:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284081920:0@lo:400:kworker.0 00000100:00080000:2.0:1787829804.922142:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787829804.926738:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284082304 00000100:00100000:0.0:1787829804.926756:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284082304 00000100:00100000:0.0:1787829804.926906:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787829804.926916:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874675284082304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829804.927012:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874675284082304:12345-0@lo:400:kworker.0 Request processed in 87us (13625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829804.927034:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787829804.928663:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1874675284082304:0@lo:400:kworker.0 00010000:00080000:3.0:1787829804.928685:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b6fa4f480 x1874675284082432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829804.928697:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284082432:0@lo:400:kworker.0 00000100:00080000:2.0:1787829804.934012:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787829805.410265:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787829805.410296:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284082560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787829805.410399:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829805.410473:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284082560 00000100:00100000:1.0:1787829805.410482:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284082560 00000100:00100000:1.0:1787829805.410536:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787829805.410546:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284082560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787829805.410594:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787829805.410664:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284082560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829805.410671:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1787829805.420112:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f4c1680 x1874675284082560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829805.420166:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284082560:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787829805.732969:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787829805.806242:0:8466:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd8076b780 20000000:00000080:3.0:1787829805.806265:0:8466:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e9b75cf2c00 uarg=0000000000000000 20000000:01000000:3.0:1787829805.806309:0:8466:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787829805.806317:0:8466:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787829805.806327:0:8466:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787829805.807573:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1787829805.807935:0:8466:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1787829805.812702:0:8466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1787829805.812790:0:8466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787829805.813581:0:8466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787829805.813688:0:8466:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787829805.813714:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e9b40030400/0xc03b4d103c0d7887 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.813736:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b40031200/0xc03b4d103c0d75fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d75f5 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.813756:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b4164ec00/0xc03b4d103c0d765e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7657 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.813772:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b40030a00/0xc03b4d103c0d7729 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7722 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.813783:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b4164e200/0xc03b4d103c0d77e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c867b expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.813792:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e9b40030400/0xc03b4d103c0d7887 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.813847:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b4164e200/0xc03b4d103c0d77e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c867b expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.813868:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9b4164e200/0xc03b4d103c0d77e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c867b expref: 9 pid: 5798 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829805.813887:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f381e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1874675284082688:192.168.201.51@tcp:104: 00010000:00010000:0.0:1787829805.815270:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b40030a00/0xc03b4d103c0d7729 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d7722 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.815286:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e9b40030a00/0xc03b4d103c0d7729 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d7722 expref: 18 pid: 5798 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829805.815312:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd1680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1874675284082816:0@lo:104: 00000100:00100000:0.0:1787829805.815382:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787829805.815423:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b4164ec00/0xc03b4d103c0d765e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d7657 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.815432:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e9b4164ec00/0xc03b4d103c0d765e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d7657 expref: 18 pid: 5798 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829805.815440:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd3840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1874675284082944:0@lo:104: 00000100:00100000:0.0:1787829805.815468:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787829805.815584:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b40031200/0xc03b4d103c0d75fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d75f5 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.815604:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e9b40031200/0xc03b4d103c0d75fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d75f5 expref: 18 pid: 5798 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829805.815613:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd3c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1874675284083072:0@lo:104: 00000100:00100000:0.0:1787829805.815633:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b44d20540 going to sleep for 11 seconds 00000100:00100000:3.0:1787829805.816446:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f381e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1874675284082688:192.168.201.51@tcp:104: 00000100:00100000:1.0:1787829805.816534:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787829805.816560:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829805.816576:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284082816 00000100:00100000:1.0:1787829805.816659:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284082816 00000100:00100000:1.0:1787829805.816710:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284082944 00000100:00100000:1.0:1787829805.816713:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284082944 00000100:00100000:1.0:1787829805.816724:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284083072 00000100:00100000:1.0:1787829805.816727:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284083072 00000100:00100000:1.0:1787829805.816824:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787829805.816837:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+5:8466:x1874675284082816:12345-0@lo:104: 00010000:00010000:1.0:1787829805.816853:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdaa00/0xc03b4d103c0d7722 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d7729 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829805.816961:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787829805.816968:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+5:8466:x1874675284082816:12345-0@lo:104: Request processed in 135us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829805.816976:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787829805.816997:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787829805.817004:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b4f8ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+4:8466:x1874675284082944:12345-0@lo:104: 00010000:00010000:1.0:1787829805.817012:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb400/0xc03b4d103c0d7657 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d765e expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829805.817063:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787829805.817067:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b4f8ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+4:8466:x1874675284082944:12345-0@lo:104: Request processed in 65us (1600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829805.817073:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787829805.817112:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787829805.817119:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:8466:x1874675284083072:12345-0@lo:104: 00010000:00010000:1.0:1787829805.817128:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdba00/0xc03b4d103c0d75f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d75fc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829805.817154:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787829805.817166:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:8466:x1874675284083072:12345-0@lo:104: Request processed in 47us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829805.817172:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1787829805.817238:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787829805.817245:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdaa00/0xc03b4d103c0d7722 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d7729 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.817253:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b48cdaa00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:0.0:1787829805.817258:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdaa00/0xc03b4d103c0d7722 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d7729 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.817274:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdaa00/0xc03b4d103c0d7722 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d7729 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787829805.817281:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdaa00/0xc03b4d103c0d7722 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d7729 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787829805.817287:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787829805.817340:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdaa00/0xc03b4d103c0d7722 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7729 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.817347:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787829805.817373:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdaa00/0xc03b4d103c0d7722 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7729 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.817382:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdaa00/0xc03b4d103c0d7722 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7729 expref: -99 pid: 7586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.817398:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787829805.817401:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb400/0xc03b4d103c0d7657 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d765e expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.817406:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b48cdb400 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:0.0:1787829805.817409:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb400/0xc03b4d103c0d7657 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d765e expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.817415:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb400/0xc03b4d103c0d7657 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d765e expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787829805.817422:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb400/0xc03b4d103c0d7657 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d765e expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787829805.817433:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787829805.817449:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb400/0xc03b4d103c0d7657 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d765e expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.817455:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787829805.817473:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb400/0xc03b4d103c0d7657 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d765e expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.817480:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdb400/0xc03b4d103c0d7657 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d765e expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.817490:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787829805.817494:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdba00/0xc03b4d103c0d75f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d75fc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.817499:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b48cdba00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:0.0:1787829805.817502:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdba00/0xc03b4d103c0d75f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d75fc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.817509:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdba00/0xc03b4d103c0d75f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d75fc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787829805.817515:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdba00/0xc03b4d103c0d75f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d75fc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787829805.817520:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787829805.817534:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdba00/0xc03b4d103c0d75f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d75fc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.817540:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787829805.817552:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdba00/0xc03b4d103c0d75f5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d75fc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.817559:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdba00/0xc03b4d103c0d75f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d75fc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.817573:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829805.817576:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829805.817578:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829805.817585:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829805.817823:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284083200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787829805.817870:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829805.817931:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284083328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787829805.817957:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829805.817976:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787829805.817981:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284083456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787829805.818000:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829805.818070:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284083200 00000100:00100000:0.0:1787829805.818075:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284083200 00010000:00010000:0.0:1787829805.818103:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b40030a00/0xc03b4d103c0d7729 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d7722 expref: 19 pid: 5798 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829805.818126:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284083328 00000100:00100000:0.0:1787829805.818129:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284083328 00010000:00010000:0.0:1787829805.818141:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b4164ec00/0xc03b4d103c0d765e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d7657 expref: 20 pid: 5798 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829805.818151:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284083456 00000100:00100000:0.0:1787829805.818154:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284083456 00010000:00010000:0.0:1787829805.818163:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b40031200/0xc03b4d103c0d75fc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d75f5 expref: 21 pid: 5798 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829805.818184:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787829805.818189:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+21:3279:x1874675284083200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787829805.818204:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829805.818209:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b40030a00/0xc03b4d103c0d7729 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d7722 expref: 21 pid: 5798 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.818218:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b40030a00/0xc03b4d103c0d7729 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d7722 expref: 21 pid: 5798 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.818239:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829805.818268:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+21:3279:x1874675284083200:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829805.818274:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787829805.818289:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787829805.818295:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+20:3280:x1874675284083328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787829805.818435:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829805.818439:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b4164ec00/0xc03b4d103c0d765e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d7657 expref: 20 pid: 5798 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.818447:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b4164ec00/0xc03b4d103c0d765e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d7657 expref: 20 pid: 5798 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.818457:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829805.818528:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+20:3280:x1874675284083328:12345-0@lo:103:ldlm_bl.0 Request processed in 232us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829805.818535:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787829805.818547:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787829805.818559:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3280:x1874675284083456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787829805.818567:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829805.818571:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b40031200/0xc03b4d103c0d75fc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d75f5 expref: 19 pid: 5798 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.818579:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b40031200/0xc03b4d103c0d75fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d75f5 expref: 19 pid: 5798 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.818589:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829805.818622:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3280:x1874675284083456:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829805.818628:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787829805.818665:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284083200:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787829805.819194:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b40030a00/0xc03b4d103c0d7729 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d7722 expref: 18 pid: 5798 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829805.819211:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd1680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1874675284082816:0@lo:104: 00010000:00010000:3.0:1787829805.819223:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b4164ec00/0xc03b4d103c0d765e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d7657 expref: 17 pid: 5798 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829805.819231:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd3840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1874675284082944:0@lo:104: 00010000:00010000:3.0:1787829805.819242:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b40031200/0xc03b4d103c0d75fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d75f5 expref: 16 pid: 5798 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829805.819251:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd3c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1874675284083072:0@lo:104: 00010000:00010000:3.0:1787829805.819280:0:8466:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e9b40030400/0xc03b4d103c0d7887 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829805.819491:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829805.819749:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275667584 00000100:00100000:0.0:1787829805.819757:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275667584 00010000:00010000:0.0:1787829805.819792:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b4164e200/0xc03b4d103c0d77e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c867b expref: 10 pid: 5798 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829805.819827:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 24 00000100:00100000:0.0:1787829805.819835:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f546940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2363:x1874675275667584:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787829805.819847:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829805.819852:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b4164e200/0xc03b4d103c0d77e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c867b expref: 10 pid: 5798 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.819865:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b4164e200/0xc03b4d103c0d77e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c867b expref: 10 pid: 5798 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.819879:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b4164e200/0xc03b4d103c0d77e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c867b expref: 10 pid: 5798 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.819900:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e9b40030400/0xc03b4d103c0d7887 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.819910:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b40030400/0xc03b4d103c0d7887 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.819927:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b40030400/0xc03b4d103c0d7887 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.819934:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b40030400/0xc03b4d103c0d7887 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.819941:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e9b40030400/0xc03b4d103c0d7887 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.819947:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e9b40030400/0xc03b4d103c0d7887 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.819953:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40030400 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787829805.819957:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e9b40030400/0xc03b4d103c0d7887 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.819965:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e9b40030400/0xc03b4d103c0d7887 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.819980:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e9b40030400/0xc03b4d103c0d7887 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829805.819988:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829805.820053:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f546940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aaccd34-1037-4ac9-aa31-e92ce8889520+9:2363:x1874675275667584:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 218us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829805.820066:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 24 00010000:00010000:3.0:1787829805.820563:0:8466:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e9b40030400/0xc03b4d103c0d7887 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829805.820575:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e9b40030400/0xc03b4d103c0d7887 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829805.820582:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b40030400/0xc03b4d103c0d7887 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829805.822367:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284083328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787829805.822401:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284083456:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787829806.758201:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829807.008556:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829807.008806:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275667712 00000100:00100000:2.0:1787829807.008822:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275667712 00000100:00100000:2.0:1787829807.008879:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 173 00000100:00100000:2.0:1787829807.008898:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+9:5602:x1874675275667712:12345-192.168.201.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787829807.008917:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829807.008937:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b4164e600/0xc03b4d103c0d788e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x53172783628c86ba expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829807.008963:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b4164e600/0xc03b4d103c0d788e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c86ba expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829807.008972:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b4164e600/0xc03b4d103c0d788e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c86ba expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829807.008979:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164e600, rc 0) 00000100:00100000:2.0:1787829807.009052:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:5602:x1874675275667712:12345-192.168.201.51@tcp:101:ll_cfg_requeue.0 Request processed in 158us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829807.009058:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 173 00000100:00100000:2.0:1787829807.012564:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829807.012710:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275667840 00000100:00100000:3.0:1787829807.012732:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275667840 00000100:00100000:3.0:1787829807.012807:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 174 00000100:00100000:3.0:1787829807.012818:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:5602:x1874675275667840:12345-192.168.201.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787829807.013431:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:5602:x1874675275667840:12345-192.168.201.51@tcp:501:ll_cfg_requeue.0 Request processed in 612us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829807.013441:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 174 00000100:00100000:3.0:1787829807.015638:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829807.015708:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275667968 00000100:00100000:2.0:1787829807.015717:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275667968 00000100:00100000:2.0:1787829807.015787:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 175 00000100:00100000:2.0:1787829807.015795:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:5602:x1874675275667968:12345-192.168.201.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787829807.016798:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:5602:x1874675275667968:12345-192.168.201.51@tcp:503:ll_cfg_requeue.0 Request processed in 998us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829807.016808:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 175 00000100:00100000:0.0:1787829807.025209:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829807.026110:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275668096 00000100:00100000:3.0:1787829807.026120:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275668096 00000100:00100000:3.0:1787829807.026169:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 176 00000100:00100000:3.0:1787829807.026178:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:6149:x1874675275668096:12345-192.168.201.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787829807.027560:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:6149:x1874675275668096:12345-192.168.201.51@tcp:502:llog_process_th.0 Request processed in 1376us (2353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829807.027572:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 176 00000100:00100000:0.0:1787829807.032093:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829807.032179:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275668224 00000100:00100000:2.0:1787829807.032201:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275668224 00000100:00100000:2.0:1787829807.032257:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 177 00000100:00100000:2.0:1787829807.032266:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:6149:x1874675275668224:12345-192.168.201.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787829807.032517:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:6149:x1874675275668224:12345-192.168.201.51@tcp:502:llog_process_th.0 Request processed in 251us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829807.032526:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 177 00010000:00010000:0.0:1787829807.779352:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787829807.842189:0:5802:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787829807.842195:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9b7f524800 from 4 10000000:01000000:1.0:1787829807.842199:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787829807.842241:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda800/0xc03b4d103c0d7895 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829807.842252:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda800/0xc03b4d103c0d7895 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829807.842263:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda800/0xc03b4d103c0d7895 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829807.842288:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284083584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787829807.842345:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829807.842396:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b60190540 going to sleep for 11 seconds 00000100:00100000:3.0:1787829807.842772:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284083584 00000100:00100000:3.0:1787829807.842779:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284083584 00000100:00100000:3.0:1787829807.842832:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787829807.842842:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:5802:x1874675284083584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787829807.842855:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829807.842869:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b596ca600/0xc03b4d103c0d789c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d7895 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829807.842961:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b596ca600/0xc03b4d103c0d789c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d7895 expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829807.843216:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b596ca600/0xc03b4d103c0d789c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7895 expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829807.843243:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b596ca600, rc 0) 00000100:00100000:2.0:1787829807.843388:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284083584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 548us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829807.843394:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787829807.843450:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284083584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787829807.843461:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda800/0xc03b4d103c0d7895 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d789c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829807.843468:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda800/0xc03b4d103c0d7895 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d789c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829807.843511:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284083712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787829807.843544:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829807.843593:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b60190540 going to sleep for 11 seconds 00000100:00100000:2.0:1787829807.843804:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284083712 00000100:00100000:2.0:1787829807.843809:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284083712 00000100:00100000:2.0:1787829807.843876:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787829807.843883:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284083712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787829807.844141:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284083712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829807.844146:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787829807.844200:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284083712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787829807.844226:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284083840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787829807.844266:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829807.844492:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fb366c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787829807.844548:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284083840 00000100:00100000:1.0:1787829807.844551:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284083840 00000100:00100000:1.0:1787829807.844567:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787829807.844571:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284083840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787829807.844916:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284083840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 342us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829807.844924:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787829807.845261:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284083840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787829807.845773:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8545:1874675284083968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787829807.845817:0:8545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829807.845880:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b601e0000 going to sleep for 11 seconds 00000100:00100000:1.0:1787829807.845920:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284083968 00000100:00100000:1.0:1787829807.845925:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284083968 00000100:00100000:1.0:1787829807.846005:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787829807.846013:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:8545:x1874675284083968:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787829807.846274:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:8545:x1874675284083968:12345-0@lo:502:llog_process_th.0 Request processed in 260us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829807.846281:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787829807.846353:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8545:1874675284083968:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787829807.846376:0:8545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787829807.846384:0:8545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787829807.846387:0:8545:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787829807.846394:0:8545:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e9b7f524800 00000020:00000080:3.0:1787829807.846397:0:8545:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787829807.846464:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8545:1874675284084096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787829807.846497:0:8545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829807.853192:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284084096 00000100:00100000:2.0:1787829807.853206:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284084096 00000100:00100000:3.0:1787829807.853240:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b601e0000 going to sleep for 11 seconds 00000100:00100000:2.0:1787829807.853426:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787829807.853438:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:8545:x1874675284084096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787829807.853781:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:8545:x1874675284084096:12345-0@lo:502:llog_process_th.0 Request processed in 345us (7282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829807.853789:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787829807.855113:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8545:1874675284084096:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787829807.855159:0:8545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787829807.855171:0:8545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787829807.855173:0:8545:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787829807.855179:0:8545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787829807.855278:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787829807.855304:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787829807.855315:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda800/0xc03b4d103c0d7895 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d789c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829807.855327:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda800/0xc03b4d103c0d7895 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d789c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787829807.855338:0:5802:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787829807.855341:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9b53977800 from 4 10000000:01000000:0.0:1787829807.855343:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787829807.855374:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d78a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829807.855383:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d78a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829807.855402:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d78a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829807.855422:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284084224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787829807.855471:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829807.855670:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284084224 00000100:00100000:0.0:1787829807.855675:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fb36000 going to sleep for 11 seconds 00000100:00100000:2.0:1787829807.855676:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284084224 00000100:00100000:2.0:1787829807.855710:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787829807.855717:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284084224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787829807.855745:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829807.855756:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b4164e400/0xc03b4d103c0d78aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d78a3 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829807.855776:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b4164e400/0xc03b4d103c0d78aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d78a3 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829807.855784:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b4164e400/0xc03b4d103c0d78aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d78a3 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829807.855790:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164e400, rc 0) 00000100:00100000:2.0:1787829807.855822:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284084224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829807.856038:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787829807.856136:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284084224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787829807.856149:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d78a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d78aa expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829807.856158:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d78a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d78aa expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829807.856522:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f545e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284084352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787829807.856552:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829807.856580:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b5870cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787829807.856597:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284084352 00000100:00100000:2.0:1787829807.856600:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284084352 00000100:00100000:2.0:1787829807.856632:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787829807.856640:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284084352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787829807.856927:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284084352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 288us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829807.856935:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787829807.856969:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f545e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284084352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787829807.857001:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f545e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284084480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787829807.857143:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829807.857166:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b5870cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787829807.857177:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284084480 00000100:00100000:2.0:1787829807.857180:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284084480 00000100:00100000:2.0:1787829807.857199:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787829807.857509:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284084480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787829807.857670:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284084480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 464us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829807.857677:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787829807.857719:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f545e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284084480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787829807.858879:0:8549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f545e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8549:1874675284084608:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787829807.858932:0:8549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829807.858963:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284084608 00000100:00100000:2.0:1787829807.858967:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284084608 00000100:00100000:2.0:1787829807.858993:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787829807.859002:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:8549:x1874675284084608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787829807.859519:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:8549:x1874675284084608:12345-0@lo:502:llog_process_th.0 Request processed in 517us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829807.859527:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787829807.859570:0:8549:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47e28b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787829807.859589:0:8549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f545e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8549:1874675284084608:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787829807.859616:0:8549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787829807.859626:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787829807.859628:0:8549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787829807.859634:0:8549:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e9b53977800 00000020:00000080:2.0:1787829807.859637:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787829807.861181:0:8549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8549:1874675284084736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787829807.861308:0:8549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829807.861346:0:8549:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b601e0000 going to sleep for 11 seconds 00000100:00100000:2.0:1787829807.861862:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284084736 00000100:00100000:2.0:1787829807.861868:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284084736 00000100:00100000:2.0:1787829807.861914:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787829807.861923:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69c97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:8549:x1874675284084736:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787829807.862165:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69c97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:8549:x1874675284084736:12345-0@lo:502:llog_process_th.0 Request processed in 242us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829807.862175:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787829807.862412:0:8549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8549:1874675284084736:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787829807.862442:0:8549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787829807.862449:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787829807.862451:0:8549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787829807.862461:0:8549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787829807.862542:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787829807.862566:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787829807.862576:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d78a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d78aa expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829807.862586:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d78a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d78aa expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787829807.862596:0:5802:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787829807.862598:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9b51a3b000 from 4 10000000:01000000:2.0:1787829807.862601:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787829807.862628:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fc00/0xc03b4d103c0d78b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829807.862635:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fc00/0xc03b4d103c0d78b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829807.862655:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fc00/0xc03b4d103c0d78b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829807.862671:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f545e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284084864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787829807.862707:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829807.862740:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47e28b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787829807.862758:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284084864 00000100:00100000:2.0:1787829807.862762:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284084864 00000100:00100000:2.0:1787829807.862807:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787829807.862817:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69c95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284084864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787829807.862827:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829807.862839:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b4164ec00/0xc03b4d103c0d78b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d78b1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829807.862862:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b4164ec00/0xc03b4d103c0d78b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d78b1 expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829807.862872:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b4164ec00/0xc03b4d103c0d78b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d78b1 expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829807.862881:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164ec00, rc 0) 00000100:00100000:2.0:1787829807.862920:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69c95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:5802:x1874675284084864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829807.862926:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787829807.863735:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f545e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284084864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787829807.863752:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fc00/0xc03b4d103c0d78b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d78b8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829807.863763:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fc00/0xc03b4d103c0d78b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d78b8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829807.863818:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284084992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787829807.863851:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829807.863879:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fb36c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787829807.863893:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284084992 00000100:00100000:0.0:1787829807.863898:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284084992 00000100:00100000:0.0:1787829807.863925:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787829807.863932:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:5802:x1874675284084992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787829807.864176:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:5802:x1874675284084992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829807.864184:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787829807.864214:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284084992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787829807.864467:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284085120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787829807.864504:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829807.864524:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fb36c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787829807.864536:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284085120 00000100:00100000:0.0:1787829807.864539:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284085120 00000100:00100000:0.0:1787829807.864559:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787829807.864564:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69c95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:5802:x1874675284085120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787829807.864690:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69c95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:5802:x1874675284085120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829807.864696:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787829807.864741:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284085120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787829807.864899:0:8550:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8550:1874675284085248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787829807.864932:0:8550:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829807.864950:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284085248 00000100:00100000:0.0:1787829807.864953:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284085248 00000100:00100000:0.0:1787829807.864972:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787829807.864977:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:8550:x1874675284085248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787829807.865109:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:8550:x1874675284085248:12345-0@lo:502:llog_process_th.0 Request processed in 131us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829807.865116:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787829807.865147:0:8550:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fb36000 going to sleep for 11 seconds 00000100:00100000:0.0:1787829807.865160:0:8550:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8550:1874675284085248:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787829807.865178:0:8550:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787829807.865186:0:8550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787829807.865188:0:8550:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787829807.865196:0:8550:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e9b51a3b000 00000020:00000080:0.0:1787829807.865198:0:8550:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787829807.865273:0:8550:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8550:1874675284085376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787829807.865303:0:8550:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829807.865322:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284085376 00000100:00100000:0.0:1787829807.865325:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284085376 00000100:00100000:0.0:1787829807.865345:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787829807.865352:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:8550:x1874675284085376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787829807.865454:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:8550:x1874675284085376:12345-0@lo:502:llog_process_th.0 Request processed in 101us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829807.865460:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787829807.865490:0:8550:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4548e480 going to sleep for 11 seconds 00000100:00100000:0.0:1787829807.865503:0:8550:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:8550:1874675284085376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787829807.865519:0:8550:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787829807.865523:0:8550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787829807.865524:0:8550:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787829807.865527:0:8550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787829807.865566:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787829807.865581:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787829807.865590:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fc00/0xc03b4d103c0d78b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d78b8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829807.865600:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fc00/0xc03b4d103c0d78b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d78b8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829808.802970:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787829809.439794:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829809.439841:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829809.439880:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829809.439939:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829809.439994:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275668736 00000100:00100000:0.0:1787829809.439999:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275668352 00000100:00100000:2.0:1787829809.440007:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275668736 00000100:00100000:0.0:1787829809.440068:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275668352 00000100:00100000:2.0:1787829809.440134:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275668608 00000100:00100000:2.0:1787829809.440141:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275668608 00000100:00100000:0.0:1787829809.440164:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 193 00000100:00100000:2.0:1787829809.440172:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 11 00000100:00100000:0.0:1787829809.440184:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2361:x1874675275668352:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829809.440189:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f545e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+5:2361:x1874675275668736:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787829809.440295:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2361:x1874675275668352:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 116us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829809.440304:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 193 00000100:00100000:3.0:1787829809.440998:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275668480 00000100:00100000:3.0:1787829809.441006:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275668480 00000100:00100000:3.0:1787829809.441083:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 32 00000100:00100000:3.0:1787829809.441094:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f546d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+6:2361:x1874675275668480:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829809.441163:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f546d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+6:2361:x1874675275668480:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 73us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829809.441170:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 32 00000100:00100000:0.0:1787829809.441993:0:6650:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787829809.442007:0:6650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787829809.443007:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f545e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+5:2361:x1874675275668736:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 2817us (3155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829809.443047:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 11 00000100:00100000:2.0:1787829809.443085:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 12 00000100:00100000:2.0:1787829809.443098:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f547840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+5:2361:x1874675275668608:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829809.443129:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f547840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+5:2361:x1874675275668608:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 37us (3190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829809.443136:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 12 00000100:00080000:2.0:1787829809.443157:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787829809.443163:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787829809.443166:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787829809.829749:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787829810.018554:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f545680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284085504:0@lo:400:kworker.0 00000100:00100000:2.0:1787829810.018621:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829810.018665:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284086016:0@lo:400:kworker.0 00000100:00100000:2.0:1787829810.018705:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829810.018732:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787829810.018738:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f545a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284085632:0@lo:400:kworker.0 00000100:00100000:2.0:1787829810.018759:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829810.018774:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284086144:0@lo:400:kworker.0 00000100:00100000:2.0:1787829810.018874:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829810.018922:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b596921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284085760:0@lo:400:kworker.0 00000100:00100000:2.0:1787829810.018948:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829810.018966:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787829810.018972:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284085888:0@lo:400:kworker.0 00000100:00100000:2.0:1787829810.018994:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829810.019047:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284085504 00000100:00100000:2.0:1787829810.019054:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284085504 00000100:00100000:2.0:1787829810.019099:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787829810.019107:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3278:x1874675284085504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829810.019156:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3278:x1874675284085504:12345-0@lo:400:kworker.0 Request processed in 50us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829810.019164:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787829810.019196:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284086016 00000100:00100000:2.0:1787829810.019199:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284086016 00000100:00100000:2.0:1787829810.019230:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284085632 00000100:00100000:2.0:1787829810.019233:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284085632 00000100:00100000:2.0:1787829810.019243:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284085760 00000100:00100000:2.0:1787829810.019245:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284085760 00000100:00100000:2.0:1787829810.019257:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787829810.019263:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ed1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1874675284086016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829810.019295:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ed1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1874675284086016:12345-0@lo:400:kworker.0 Request processed in 31us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829810.019300:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787829810.019312:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787829810.019317:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284085632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829810.019341:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284085632:12345-0@lo:400:kworker.0 Request processed in 25us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829810.019354:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787829810.019366:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787829810.019371:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284085760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829810.019404:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284085760:12345-0@lo:400:kworker.0 Request processed in 33us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829810.019409:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787829810.019431:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284086144 00000100:00100000:2.0:1787829810.019434:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284086144 00000100:00100000:2.0:1787829810.019459:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284085888 00000100:00100000:2.0:1787829810.019462:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284085888 00000100:00100000:2.0:1787829810.019483:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787829810.019490:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284086144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829810.019520:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284086144:12345-0@lo:400:kworker.0 Request processed in 31us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829810.019526:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787829810.019536:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787829810.019542:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284085888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829810.019566:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284085888:12345-0@lo:400:kworker.0 Request processed in 24us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829810.019571:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1787829810.019593:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787829810.019596:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787829810.019599:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787829810.019627:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b48ed30c0 x1874675284085888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829810.019641:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284085888:0@lo:400:kworker.0 00000100:00100000:2.0:1787829810.019660:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b596921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284085760:0@lo:400:kworker.0 00000100:00100000:2.0:1787829810.019702:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f545a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284085632:0@lo:400:kworker.0 00010000:00080000:2.0:1787829810.019713:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b48ed0f00 x1874675284086144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829810.019722:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284086144:0@lo:400:kworker.0 00000100:00100000:2.0:1787829810.019730:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f545680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284085504:0@lo:400:kworker.0 00000100:00100000:2.0:1787829810.019739:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284086016:0@lo:400:kworker.0 00000100:00100000:3.0:1787829810.020884:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284086272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787829810.020931:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829810.021057:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284086272 00000100:00100000:1.0:1787829810.021063:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284086272 00000100:00100000:1.0:1787829810.021094:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787829810.021101:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284086272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787829810.021132:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787829810.021542:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284086272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 440us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829810.021551:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787829810.024655:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9a424f2580 x1874675284086272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829810.024680:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284086272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787829810.530636:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787829810.530659:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284086400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787829810.530739:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829810.530801:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284086400 00000100:00100000:0.0:1787829810.530809:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284086400 00000100:00100000:0.0:1787829810.530857:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787829810.530865:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284086400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787829810.530900:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787829810.530944:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284086400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829810.530951:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1787829810.530990:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b75cd0780 x1874675284086400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829810.531009:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284086400:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787829810.857919:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787829811.818283:0:8767:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg151-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1787829811.874408:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829812.898629:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829813.922587:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829814.566651:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829814.574377:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275668864 00000100:00100000:2.0:1787829814.574393:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275668864 00000100:00100000:0.0:1787829814.576546:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 195 00000100:00100000:0.0:1787829814.576564:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2363:x1874675275668864:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787829814.576758:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2363:x1874675275668864:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 197us (10121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829814.576768:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 195 00000100:00100000:3.0:1787829814.577760:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829814.578014:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829814.578091:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829814.578125:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275669120 00000100:00100000:3.0:1787829814.578196:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275669120 00000100:00100000:3.0:1787829814.578259:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275669248 00000100:00100000:3.0:1787829814.578263:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275669248 00000100:00100000:3.0:1787829814.578289:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 10 00000100:00100000:3.0:1787829814.578299:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+5:2359:x1874675275669120:12345-192.168.201.51@tcp:9:kworker.0 00000020:00000080:3.0:1787829814.578340:0:6652:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d77f4 00000100:00080000:3.0:1787829814.578353:0:6652:0:(import.c:65:import_set_state_nolock()) ffff9e9b75da2800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787829814.578403:0:6652:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787829814.578828:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+2:2359:x1874675275669120:12345-192.168.201.51@tcp:9:kworker.0 Request processed in 529us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829814.578854:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 10 00000100:00100000:3.0:1787829814.578873:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 11 00000100:00100000:3.0:1787829814.578880:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+5:2359:x1874675275669248:12345-192.168.201.51@tcp:9:kworker.0 00000020:00000080:3.0:1787829814.578896:0:6652:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d77fb 00000100:00080000:3.0:1787829814.578904:0:6652:0:(import.c:65:import_set_state_nolock()) ffff9e9b75da4000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787829814.578930:0:6652:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787829814.579179:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+2:2359:x1874675275669248:12345-192.168.201.51@tcp:9:kworker.0 Request processed in 299us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829814.579187:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 11 00000100:00080000:3.0:1787829814.579212:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787829814.579216:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787829814.579362:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829814.579494:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787829814.581487:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275668992 00000100:00100000:2.0:1787829814.581505:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275668992 00000100:00100000:1.0:1787829814.581803:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 36 00000100:00100000:1.0:1787829814.581827:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+6:2363:x1874675275668992:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829814.581989:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+6:2363:x1874675275668992:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 176us (4234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829814.581997:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 36 00000100:00080000:3.0:1787829814.582074:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787829814.956464:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829815.139573:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284086528:0@lo:400:kworker.0 00000100:00100000:0.0:1787829815.139657:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829815.139706:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284087040:0@lo:400:kworker.0 00000100:00100000:0.0:1787829815.139730:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829815.139812:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787829815.139819:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284086656:0@lo:400:kworker.0 00000100:00100000:0.0:1787829815.139841:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829815.139858:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284087168:0@lo:400:kworker.0 00000100:00100000:0.0:1787829815.139879:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829815.139906:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284086784:0@lo:400:kworker.0 00000100:00100000:0.0:1787829815.139929:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829815.139946:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787829815.139951:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284086912:0@lo:400:kworker.0 00000100:00100000:0.0:1787829815.139972:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829815.140002:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284086528 00000100:00100000:0.0:1787829815.140010:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284086528 00000100:00100000:0.0:1787829815.140078:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787829815.140088:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3278:x1874675284086528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829815.140137:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3278:x1874675284086528:12345-0@lo:400:kworker.0 Request processed in 50us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829815.140157:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787829815.140269:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284087040 00000100:00100000:0.0:1787829815.140273:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284087040 00000100:00100000:0.0:1787829815.140311:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284086656 00000100:00100000:0.0:1787829815.140315:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284086656 00000100:00100000:0.0:1787829815.140328:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284086784 00000100:00100000:0.0:1787829815.140331:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284086784 00000100:00100000:0.0:1787829815.140346:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787829815.140352:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1874675284087040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829815.140384:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1874675284087040:12345-0@lo:400:kworker.0 Request processed in 33us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829815.140391:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787829815.140404:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787829815.140409:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284086656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829815.140431:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284086656:12345-0@lo:400:kworker.0 Request processed in 23us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829815.140437:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787829815.140447:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787829815.140453:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284086784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829815.140483:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284086784:12345-0@lo:400:kworker.0 Request processed in 30us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829815.140488:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787829815.140507:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284087168 00000100:00100000:0.0:1787829815.140510:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284087168 00000100:00100000:0.0:1787829815.140534:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284086912 00000100:00100000:0.0:1787829815.140536:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284086912 00000100:00100000:0.0:1787829815.140554:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787829815.140567:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284087168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829815.140605:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284087168:12345-0@lo:400:kworker.0 Request processed in 30us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829815.140612:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787829815.140622:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787829815.140628:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284086912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829815.140653:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284086912:12345-0@lo:400:kworker.0 Request processed in 25us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829815.140659:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1787829815.140683:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787829815.140687:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787829815.140689:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787829815.140721:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b75cd0000 x1874675284086912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829815.140735:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284086912:0@lo:400:kworker.0 00000100:00100000:0.0:1787829815.140747:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284086784:0@lo:400:kworker.0 00000100:00100000:0.0:1787829815.140773:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284086656:0@lo:400:kworker.0 00010000:00080000:0.0:1787829815.140782:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b75cd21c0 x1874675284087168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829815.140790:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284087168:0@lo:400:kworker.0 00000100:00100000:0.0:1787829815.140797:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284086528:0@lo:400:kworker.0 00000100:00100000:0.0:1787829815.140806:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284087040:0@lo:400:kworker.0 00000100:00100000:3.0:1787829815.148087:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284087296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787829815.148192:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829815.150578:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284087296 00000100:00100000:3.0:1787829815.150591:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284087296 00000100:00100000:3.0:1787829815.150659:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787829815.150670:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284087296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787829815.150702:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787829815.150769:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284087296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (2577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829815.150776:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1787829815.150862:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f4c3840 x1874675284087296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829815.150881:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284087296:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1787829815.237136:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b6abf229-545c-43fd-8dee-d9adf582be48 00000020:00000080:1.0:1787829815.237147:0:6674:0:(genops.c:885:class_export_put()) final put ffff9e9b75da2000/b6abf229-545c-43fd-8dee-d9adf582be48 00000020:00000080:0.0:1787829815.237235:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b75da2000/b6abf229-545c-43fd-8dee-d9adf582be48 for lustre-OST0000 00000020:00000080:0.0:1787829815.237290:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b75da2800 for lustre-OST0000 00000100:00100000:0.0:1787829815.654518:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284087424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787829815.654608:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829815.654791:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284087424 00000100:00100000:2.0:1787829815.654800:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284087424 00000100:00100000:2.0:1787829815.654854:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787829815.654865:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284087424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787829815.654902:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787829815.654954:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284087424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829815.654961:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1787829815.654999:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9a424f1a40 x1874675284087424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829815.655039:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284087424:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787829815.972715:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829817.001767:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787829817.455827:0:9013:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg151-server.virtnet: executing yml_node 00010000:00010000:1.0:1787829818.018310:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829819.042296:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787829819.293734:0:7602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b6abf229-545c-43fd-8dee-d9adf582be48 00000020:00000080:3.0:1787829819.293745:0:7602:0:(genops.c:885:class_export_put()) final put ffff9e9b75da0800/b6abf229-545c-43fd-8dee-d9adf582be48 00000020:00000080:1.0:1787829819.294212:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b75da0800/b6abf229-545c-43fd-8dee-d9adf582be48 for lustre-OST0001 00000020:00000080:1.0:1787829819.294273:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b75da4000 for lustre-OST0001 00000100:00100000:0.0:1787829819.692186:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829819.692237:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829819.692346:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275669504 00000100:00100000:1.0:1787829819.692358:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275669504 00000100:00100000:1.0:1787829819.692444:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 40 00000100:00100000:1.0:1787829819.692455:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+6:2363:x1874675275669504:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829819.692545:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+6:2363:x1874675275669504:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 92us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829819.692554:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 40 00000100:00100000:2.0:1787829819.692620:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275669376 00000100:00100000:2.0:1787829819.692624:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275669376 00000100:00100000:2.0:1787829819.692677:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 197 00000100:00100000:2.0:1787829819.692684:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2363:x1874675275669376:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829819.692711:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2363:x1874675275669376:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 29us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829819.692717:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 197 00000100:00080000:0.0:1787829819.693289:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787829820.066350:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829820.258283:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284087936:0@lo:400:kworker.0 00000100:00100000:1.0:1787829820.258368:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829820.258427:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787829820.258434:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1874675284087808:0@lo:400:kworker.0 00000100:00100000:0.0:1787829820.258447:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284087552:0@lo:400:kworker.0 00000100:00100000:1.0:1787829820.258460:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829820.258477:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829820.258497:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284088064:0@lo:400:kworker.0 00000100:00100000:1.0:1787829820.258504:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284087936 00000100:00100000:0.0:1787829820.258530:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829820.258534:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284087936 00000100:00100000:0.0:1787829820.258547:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787829820.258552:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284087680:0@lo:400:kworker.0 00000100:00100000:0.0:1787829820.258570:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829820.258585:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284088192:0@lo:400:kworker.0 00000100:00100000:1.0:1787829820.258589:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787829820.258598:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284087936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829820.258603:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829820.258625:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284087808 00000100:00100000:0.0:1787829820.258628:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284087808 00000100:00100000:1.0:1787829820.258647:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284087936:12345-0@lo:400:kworker.0 Request processed in 51us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829820.258654:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787829820.258656:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284088064 00000100:00100000:0.0:1787829820.258658:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284088064 00000100:00100000:1.0:1787829820.258667:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284088192 00000100:00100000:0.0:1787829820.258668:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284087680 00000100:00100000:1.0:1787829820.258670:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284088192 00000100:00100000:0.0:1787829820.258670:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284087680 00000100:00100000:0.0:1787829820.258682:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787829820.258687:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787829820.258688:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874675284087808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829820.258692:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284088192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829820.258717:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284088192:12345-0@lo:400:kworker.0 Request processed in 26us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829820.258717:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874675284087808:12345-0@lo:400:kworker.0 Request processed in 29us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829820.258728:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787829820.258735:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787829820.258741:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787829820.258779:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1874675284087808:0@lo:400:kworker.0 00010000:00080000:1.0:1787829820.258793:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f4c2940 x1874675284087936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829820.258803:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284087936:0@lo:400:kworker.0 00000100:00100000:0.0:1787829820.259170:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1874675284088064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829820.259202:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1874675284088064:12345-0@lo:400:kworker.0 Request processed in 37us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829820.260745:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284088320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787829820.260809:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787829820.260860:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787829820.260865:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787829820.260868:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787829820.260896:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284087552 00000100:00100000:3.0:1787829820.260902:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284087552 00000100:00100000:3.0:1787829820.260943:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787829820.260950:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3278:x1874675284087552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829820.260991:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3278:x1874675284087552:12345-0@lo:400:kworker.0 Request processed in 42us (2513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829820.260997:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787829820.261064:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284088320 00000100:00100000:3.0:1787829820.261068:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284088320 00000100:00100000:3.0:1787829820.261093:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787829820.261099:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284088320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787829820.261397:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787829820.261444:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284088320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 345us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829820.261451:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1787829820.261485:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b6fa4c3c0 x1874675284088320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829820.261504:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284088320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787829820.263096:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787829820.263120:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284087680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829820.263193:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284087680:12345-0@lo:400:kworker.0 Request processed in 86us (4622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829820.263200:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787829820.263281:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284087680:0@lo:400:kworker.0 00010000:00080000:1.0:1787829820.263297:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f4c3840 x1874675284088192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829820.263450:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284088192:0@lo:400:kworker.0 00000100:00100000:1.0:1787829820.263466:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284087552:0@lo:400:kworker.0 00000100:00100000:1.0:1787829820.263480:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284088064:0@lo:400:kworker.0 00000100:00100000:0.0:1787829820.270062:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787829820.770520:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284088448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787829820.770597:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829820.770837:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284088448 00000100:00100000:2.0:1787829820.770845:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284088448 00000100:00100000:2.0:1787829820.770899:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787829820.770909:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284088448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787829820.770944:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787829820.771001:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284088448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829820.771008:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1787829820.771150:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9a424f1a40 x1874675284088448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829820.771170:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284088448:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787829821.090812:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829822.114423:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787829822.887319:0:9206:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.64 00010000:00010000:0.0:1787829823.139954:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829824.162252:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829824.798265:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829824.798317:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829824.798423:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275669760 00000100:00100000:2.0:1787829824.798447:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275669760 00000100:00080000:3.0:1787829824.798512:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787829824.798529:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 44 00000100:00100000:2.0:1787829824.798544:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+6:2360:x1874675275669760:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829824.798644:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+6:2360:x1874675275669760:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 105us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829824.798652:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 44 00000100:00100000:1.0:1787829824.799559:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275669632 00000100:00100000:1.0:1787829824.799567:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275669632 00000100:00100000:1.0:1787829824.799607:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 199 00000100:00100000:1.0:1787829824.799616:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2360:x1874675275669632:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829824.799670:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2360:x1874675275669632:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 56us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829824.799677:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 199 00010000:00010000:1.0:1787829825.189261:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829825.380294:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284088576:0@lo:400:kworker.0 00000100:00100000:0.0:1787829825.380366:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829825.380414:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b47a7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284089088:0@lo:400:kworker.0 00000100:00100000:0.0:1787829825.380452:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829825.380477:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787829825.380483:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b47a7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284088704:0@lo:400:kworker.0 00000100:00100000:0.0:1787829825.380502:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829825.380520:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b47a7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284089216:0@lo:400:kworker.0 00000100:00100000:0.0:1787829825.380542:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829825.380573:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b47a7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284088832:0@lo:400:kworker.0 00000100:00100000:0.0:1787829825.380596:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829825.380620:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787829825.380626:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b47a7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284088960:0@lo:400:kworker.0 00000100:00100000:0.0:1787829825.380647:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829825.380679:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284088576 00000100:00100000:0.0:1787829825.380685:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284088576 00000100:00100000:0.0:1787829825.380728:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787829825.380736:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3278:x1874675284088576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829825.380787:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3278:x1874675284088576:12345-0@lo:400:kworker.0 Request processed in 51us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829825.380794:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787829825.380824:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284089088 00000100:00100000:0.0:1787829825.380827:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284089088 00000100:00100000:0.0:1787829825.380861:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284088704 00000100:00100000:0.0:1787829825.380864:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284088704 00000100:00100000:0.0:1787829825.380876:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284088832 00000100:00100000:0.0:1787829825.380878:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284088832 00000100:00100000:0.0:1787829825.380892:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787829825.380898:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b47a79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1874675284089088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829825.380931:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b47a79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1874675284089088:12345-0@lo:400:kworker.0 Request processed in 34us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829825.380937:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787829825.380948:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787829825.380953:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b47a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284088704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829825.380980:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b47a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284088704:12345-0@lo:400:kworker.0 Request processed in 27us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829825.380986:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787829825.380997:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787829825.381003:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b47a7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284088832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829825.381077:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b47a7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284088832:12345-0@lo:400:kworker.0 Request processed in 74us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829825.381083:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787829825.381104:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284089216 00000100:00100000:0.0:1787829825.381107:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284089216 00000100:00100000:0.0:1787829825.381129:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284088960 00000100:00100000:0.0:1787829825.381131:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284088960 00000100:00100000:0.0:1787829825.381152:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787829825.381158:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b47a78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284089216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829825.381188:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b47a78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284089216:12345-0@lo:400:kworker.0 Request processed in 30us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829825.381194:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787829825.381204:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787829825.381210:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b47a78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284088960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829825.381236:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b47a78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284088960:12345-0@lo:400:kworker.0 Request processed in 27us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829825.381242:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1787829825.381259:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787829825.381263:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787829825.381265:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787829825.381293:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b47a7bc00 x1874675284088960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829825.381305:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b47a7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284088960:0@lo:400:kworker.0 00000100:00100000:0.0:1787829825.381316:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b47a7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284088832:0@lo:400:kworker.0 00000100:00100000:0.0:1787829825.381343:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b47a7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284088704:0@lo:400:kworker.0 00010000:00080000:0.0:1787829825.381366:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b47a7a580 x1874675284089216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829825.381375:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b47a7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284089216:0@lo:400:kworker.0 00000100:00100000:0.0:1787829825.381382:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284088576:0@lo:400:kworker.0 00000100:00100000:0.0:1787829825.381390:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b47a7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284089088:0@lo:400:kworker.0 00000100:00100000:0.0:1787829825.387996:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787829825.388468:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284089344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787829825.388539:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829825.388695:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284089344 00000100:00100000:2.0:1787829825.388703:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284089344 00000100:00100000:2.0:1787829825.388758:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787829825.388768:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b47a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284089344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787829825.388807:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787829825.388863:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b47a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284089344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829825.388880:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1787829825.388950:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f4c0780 x1874675284089344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829825.388971:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284089344:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787829825.707545:0:9305:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.64 00000100:00100000:3.0:1787829825.892883:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787829825.892909:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284089472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787829825.892983:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829825.893078:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284089472 00000100:00100000:3.0:1787829825.893086:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284089472 00000100:00100000:3.0:1787829825.893131:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787829825.893141:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284089472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787829825.893178:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787829825.893224:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284089472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829825.893232:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1787829825.893272:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b6fa4c3c0 x1874675284089472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829825.893290:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284089472:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787829826.218253:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829827.234587:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829828.269381:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787829828.391988:0:9402:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.64 00010000:00010000:1.0:1787829829.283444:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829829.932989:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829829.933092:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829829.933176:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275669888 00000100:00100000:2.0:1787829829.933186:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275669888 00000100:00100000:2.0:1787829829.933245:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 201 00000100:00100000:2.0:1787829829.933255:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2363:x1874675275669888:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829829.933354:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2363:x1874675275669888:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 85us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829829.933362:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 201 00000100:00100000:3.0:1787829829.933837:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275670016 00000100:00100000:3.0:1787829829.933842:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275670016 00000100:00100000:3.0:1787829829.933897:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 48 00000100:00080000:1.0:1787829829.934069:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787829829.934155:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+6:2363:x1874675275670016:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829829.934194:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+6:2363:x1874675275670016:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 44us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829829.936206:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 48 00000001:02000400:2.0:1787829830.044218:0:9450:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Aug 27 07:23:49 EDT 2026 00010000:00010000:0.0:1787829830.307064:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787829830.498237:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787829830.498256:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284089600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787829830.498324:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829830.498440:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284089600 00000100:00100000:1.0:1787829830.498448:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284089600 00000100:00100000:1.0:1787829830.498504:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787829830.498531:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284089600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787829830.498583:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787829830.498630:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284089600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829830.498637:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1787829830.498677:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f4c1a40 x1874675284089600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829830.498695:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284089600:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787829830.498757:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787829830.499520:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284090112:0@lo:400:kworker.0 00000100:00100000:3.0:1787829830.499571:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829830.499595:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787829830.499599:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284089728:0@lo:400:kworker.0 00000100:00100000:3.0:1787829830.499618:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829830.499633:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284090240:0@lo:400:kworker.0 00000100:00100000:3.0:1787829830.499646:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829830.499663:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874675284089856:0@lo:400:kworker.0 00000100:00100000:3.0:1787829830.499676:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829830.499688:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787829830.499691:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f381e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284089984:0@lo:400:kworker.0 00000100:00100000:3.0:1787829830.499702:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829830.499720:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284090112 00000100:00100000:3.0:1787829830.499723:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284090112 00000100:00100000:3.0:1787829830.499746:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284089856 00000100:00100000:3.0:1787829830.499748:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284089856 00000100:00100000:3.0:1787829830.499755:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284089984 00000100:00100000:3.0:1787829830.499756:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284089984 00000100:00100000:3.0:1787829830.499766:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787829830.499770:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1874675284090112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829830.499797:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1874675284090112:12345-0@lo:400:kworker.0 Request processed in 27us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829830.499801:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787829830.499821:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787829830.499825:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874675284089856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829830.499846:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874675284089856:12345-0@lo:400:kworker.0 Request processed in 21us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829830.499849:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787829830.499855:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787829830.499858:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284089984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829830.499872:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284089984:12345-0@lo:400:kworker.0 Request processed in 14us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829830.499875:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787829830.499886:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284089728 00000100:00100000:3.0:1787829830.499888:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284089728 00000100:00100000:3.0:1787829830.499904:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787829830.499907:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3278:x1874675284089728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829830.499923:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3278:x1874675284089728:12345-0@lo:400:kworker.0 Request processed in 16us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829830.499926:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787829830.499943:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284090240 00000100:00100000:3.0:1787829830.499945:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284090240 00000100:00100000:3.0:1787829830.499960:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787829830.499964:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284090240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829830.499980:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284090240:12345-0@lo:400:kworker.0 Request processed in 16us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829830.499984:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1787829830.500001:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787829830.500004:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787829830.500038:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f381e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284089984:0@lo:400:kworker.0 00000100:00100000:3.0:1787829830.500052:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874675284089856:0@lo:400:kworker.0 00000100:00100000:3.0:1787829830.500068:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284089728:0@lo:400:kworker.0 00010000:00080000:3.0:1787829830.500075:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7fa470c0 x1874675284090240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829830.500082:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284090240:0@lo:400:kworker.0 00000100:00100000:3.0:1787829830.500087:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284090112:0@lo:400:kworker.0 00000100:00100000:3.0:1787829831.013239:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284090368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787829831.013307:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829831.013485:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284090368 00000100:00100000:0.0:1787829831.013494:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284090368 00000100:00100000:0.0:1787829831.013554:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787829831.013565:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284090368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787829831.013599:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787829831.024765:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284090368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 11191us (11446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829831.024779:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1787829831.026617:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9a424f2d00 x1874675284090368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829831.026646:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284090368:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787829831.337155:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829832.354180:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829833.381418:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829834.402389:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829835.041343:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829835.041392:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829835.041508:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275670272 00000100:00100000:3.0:1787829835.041526:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275670272 00000100:00100000:3.0:1787829835.041630:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 52 00000100:00080000:0.0:1787829835.041636:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787829835.041646:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b47a7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+6:2363:x1874675275670272:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829835.041768:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b47a7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+6:2363:x1874675275670272:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 128us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829835.041777:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 52 00000100:00100000:2.0:1787829835.042257:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275670144 00000100:00100000:2.0:1787829835.042268:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275670144 00000100:00100000:2.0:1787829835.042325:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 203 00000100:00100000:2.0:1787829835.042451:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2363:x1874675275670144:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829835.042524:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2363:x1874675275670144:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 190us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829835.042532:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 203 00010000:00010000:1.0:1787829835.432195:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829835.621216:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b47a7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874675284090752:0@lo:400:kworker.0 00000100:00100000:0.0:1787829835.621328:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829835.621409:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b47a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284091264:0@lo:400:kworker.0 00000100:00100000:0.0:1787829835.621442:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829835.621475:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787829835.621481:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b47a7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284090624:0@lo:400:kworker.0 00000100:00100000:0.0:1787829835.621515:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829835.621535:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b47a783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1874675284091136:0@lo:400:kworker.0 00000100:00100000:0.0:1787829835.621557:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829835.621890:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284090496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787829835.621928:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829835.621960:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b47a792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284091008:0@lo:400:kworker.0 00000100:00100000:2.0:1787829835.621981:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829835.622013:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787829835.622054:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b47a79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1874675284090880:0@lo:400:kworker.0 00000100:00100000:2.0:1787829835.622079:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829835.622118:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284091264 00000100:00100000:2.0:1787829835.622127:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284091264 00000100:00100000:2.0:1787829835.622255:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284091008 00000100:00100000:2.0:1787829835.622259:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284091008 00000100:00100000:2.0:1787829835.622289:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787829835.622300:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b47a79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284091264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829835.622368:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b47a79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284091264:12345-0@lo:400:kworker.0 Request processed in 70us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829835.622376:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787829835.622396:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787829835.622402:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284091008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829835.622435:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284091008:12345-0@lo:400:kworker.0 Request processed in 34us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829835.622441:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1787829835.622483:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b47a792c0 x1874675284091008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829835.622501:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b47a792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284091008:0@lo:400:kworker.0 00000100:00100000:3.0:1787829835.622697:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284090752 00000100:00100000:3.0:1787829835.622702:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284090752 00000100:00100000:3.0:1787829835.622738:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284091136 00000100:00100000:3.0:1787829835.622741:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284091136 00000100:00100000:3.0:1787829835.622755:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284090880 00000100:00100000:3.0:1787829835.622757:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284090880 00000100:00100000:3.0:1787829835.622771:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787829835.622778:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b47a78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1874675284090752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829835.622819:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b47a78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1874675284090752:12345-0@lo:400:kworker.0 Request processed in 42us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829835.622836:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787829835.622851:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787829835.622857:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b47a7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1874675284091136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829835.622888:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b47a7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1874675284091136:12345-0@lo:400:kworker.0 Request processed in 31us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829835.622893:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787829835.622905:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787829835.622910:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874675284090880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829835.622945:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874675284090880:12345-0@lo:400:kworker.0 Request processed in 34us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829835.622951:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787829835.622973:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284090624 00000100:00100000:3.0:1787829835.622977:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284090624 00000100:00100000:3.0:1787829835.623007:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787829835.623013:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3279:x1874675284090624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829835.623070:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3279:x1874675284090624:12345-0@lo:400:kworker.0 Request processed in 58us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829835.623077:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787829835.623143:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b47a79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1874675284090880:0@lo:400:kworker.0 00000100:00100000:0.0:1787829835.623374:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284090496 00000100:00100000:0.0:1787829835.623380:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284090496 00000100:00100000:0.0:1787829835.623413:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787829835.623421:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284090496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787829835.623460:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787829835.623505:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284090496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829835.623512:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1787829835.623533:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787829835.623540:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787829835.623543:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787829835.623568:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b47a7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284090624:0@lo:400:kworker.0 00000100:00100000:0.0:1787829835.623581:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b47a783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1874675284091136:0@lo:400:kworker.0 00000100:00100000:0.0:1787829835.623594:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b47a7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874675284090752:0@lo:400:kworker.0 00010000:00080000:0.0:1787829835.623610:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b47a78000 x1874675284091264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829835.623622:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b47a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284091264:0@lo:400:kworker.0 00010000:00080000:3.0:1787829835.623902:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b5955d680 x1874675284090496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829835.623920:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284090496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787829836.130298:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787829836.130331:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284091392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787829836.130428:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829836.130686:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284091392 00000100:00100000:2.0:1787829836.130697:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284091392 00000100:00100000:2.0:1787829836.130767:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787829836.130788:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284091392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787829836.131171:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787829836.131309:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284091392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 523us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829836.131338:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1787829836.132680:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9a424f03c0 x1874675284091392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829836.132713:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284091392:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787829836.454115:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829837.474262:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829838.498993:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829839.534605:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787829840.161456:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829840.163351:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275670528 00000100:00100000:1.0:1787829840.163367:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275670528 00000100:00100000:1.0:1787829840.163461:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 56 00000100:00100000:1.0:1787829840.163473:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:2361:x1874675275670528:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829840.163565:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:2361:x1874675275670528:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 95us (2118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829840.163582:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 56 00000100:00080000:3.0:1787829840.163646:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787829840.176426:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829840.176495:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275670400 00000100:00100000:3.0:1787829840.176505:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275670400 00000100:00100000:3.0:1787829840.176562:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 205 00000100:00100000:3.0:1787829840.176572:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2360:x1874675275670400:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829840.176649:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2360:x1874675275670400:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 78us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829840.177000:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 205 00010000:00010000:0.0:1787829840.546340:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829840.739531:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787829840.739554:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284091520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787829840.739622:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829840.739692:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284091520 00000100:00100000:1.0:1787829840.739699:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284091520 00000100:00080000:2.0:1787829840.739760:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787829840.739910:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284091648:0@lo:400:kworker.0 00000100:00100000:2.0:1787829840.739945:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829840.739967:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284092160:0@lo:400:kworker.0 00000100:00100000:0.0:1787829840.739971:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874675284091776:0@lo:400:kworker.0 00000100:00100000:2.0:1787829840.739991:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829840.739998:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829840.740039:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284092160 00000100:00100000:0.0:1787829840.740042:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284091776 00000100:00100000:2.0:1787829840.740043:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284092160 00000100:00100000:0.0:1787829840.740045:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284091776 00000100:00100000:2.0:1787829840.740079:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787829840.740079:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787829840.740088:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284092160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829840.740088:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b47a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1874675284091776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829840.740135:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284092160:12345-0@lo:400:kworker.0 Request processed in 50us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829840.740135:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b47a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1874675284091776:12345-0@lo:400:kworker.0 Request processed in 48us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829840.740143:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787829840.740143:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1787829840.740173:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787829840.740176:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1874675284092032:0@lo:400:kworker.0 00010000:00080000:2.0:1787829840.740198:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b6fa4c3c0 x1874675284092160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829840.740200:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829840.740212:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284092160:0@lo:400:kworker.0 00000100:00100000:0.0:1787829840.740216:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787829840.740222:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1874675284091904:0@lo:400:kworker.0 00000100:00100000:0.0:1787829840.740242:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829840.740282:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874675284091776:0@lo:400:kworker.0 00000100:00100000:0.0:1787829840.740315:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284092032 00000100:00100000:0.0:1787829840.740319:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284092032 00000100:00100000:0.0:1787829840.740343:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284091904 00000100:00100000:0.0:1787829840.740346:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284091904 00000100:00100000:0.0:1787829840.740363:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787829840.740369:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b47a7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874675284092032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829840.740402:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b47a7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874675284092032:12345-0@lo:400:kworker.0 Request processed in 33us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829840.740408:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787829840.740432:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787829840.740438:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b47a783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874675284091904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829840.740466:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b47a783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874675284091904:12345-0@lo:400:kworker.0 Request processed in 28us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829840.740472:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787829840.740485:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284091648 00000100:00080000:0.0:1787829840.740486:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787829840.740490:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284091648 00000100:00100000:0.0:1787829840.740500:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1874675284091904:0@lo:400:kworker.0 00000100:00100000:0.0:1787829840.740509:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1874675284092032:0@lo:400:kworker.0 00000100:00100000:3.0:1787829840.740514:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787829840.740520:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3278:x1874675284091648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829840.740567:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3278:x1874675284091648:12345-0@lo:400:kworker.0 Request processed in 47us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829840.740573:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787829840.741218:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284091648:0@lo:400:kworker.0 00000100:00100000:1.0:1787829840.741591:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787829840.741604:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284091520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787829840.741639:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787829840.742240:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284091520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 638us (2615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829840.742249:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1787829840.742955:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f4c1a40 x1874675284091520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829840.742980:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284091520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787829841.254394:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284092288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787829841.254470:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829841.254566:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284092288 00000100:00100000:0.0:1787829841.254575:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284092288 00000100:00100000:0.0:1787829841.254626:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787829841.254635:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b47a7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284092288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787829841.254679:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787829841.254728:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b47a7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284092288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829841.254735:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1787829841.254775:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9a424f2940 x1874675284092288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829841.254792:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284092288:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787829841.570279:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829842.598836:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829843.618259:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829844.642272:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829845.279946:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829845.280056:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829845.280109:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275670656 00000100:00100000:1.0:1787829845.280176:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275670784 00000100:00100000:1.0:1787829845.280186:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275670784 00000100:00100000:3.0:1787829845.280196:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275670656 00000100:00100000:3.0:1787829845.280254:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 207 00000100:00100000:1.0:1787829845.280254:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 60 00000100:00100000:3.0:1787829845.280264:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2361:x1874675275670656:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829845.280264:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b47a7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:2361:x1874675275670784:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829845.280352:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2361:x1874675275670656:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 89us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829845.280360:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 207 00000100:00080000:0.0:1787829845.280419:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787829845.285870:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b47a7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:2361:x1874675275670784:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 5585us (5918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829845.285892:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 60 00010000:00010000:1.0:1787829845.671977:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829845.860355:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b47a79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874675284092544:0@lo:400:kworker.0 00000100:00100000:0.0:1787829845.862331:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829845.863861:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284093056:0@lo:400:kworker.0 00000100:00100000:0.0:1787829845.863933:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829845.864611:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284092800:0@lo:400:kworker.0 00000100:00100000:3.0:1787829845.864909:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284092544 00000100:00100000:1.0:1787829845.865225:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284092672:0@lo:400:kworker.0 00000100:00100000:1.0:1787829845.865264:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829845.865311:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284093184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787829845.865577:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b47a792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284092416:0@lo:400:kworker.0 00000100:00100000:2.0:1787829845.865620:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829845.866099:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1874675284092928:0@lo:400:kworker.0 00000100:00100000:2.0:1787829845.866131:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829845.866177:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284092672 00000100:00100000:2.0:1787829845.866183:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284092672 00000100:00100000:2.0:1787829845.866251:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284092928 00000100:00100000:2.0:1787829845.866255:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284092928 00000100:00100000:2.0:1787829845.866289:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787829845.866298:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284092672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829845.868329:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284092544 00000100:00100000:3.0:1787829845.868515:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787829845.868528:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874675284092928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829845.872598:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829845.872856:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284093056 00000100:00100000:0.0:1787829845.872868:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284093056 00000100:00100000:0.0:1787829845.872947:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284092800 00000100:00100000:0.0:1787829845.872950:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284092800 00000100:00100000:0.0:1787829845.872978:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787829845.872991:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284093056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829845.874874:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284093056:12345-0@lo:400:kworker.0 Request processed in 1873us (10927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829845.874891:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787829845.874935:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787829845.875188:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284092800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829845.875259:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284092800:12345-0@lo:400:kworker.0 Request processed in 317us (2673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829845.875265:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1787829845.875332:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7fa47480 x1874675284092800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829845.875529:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829845.875584:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284093184 00000100:00100000:1.0:1787829845.875593:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284093184 00000100:00100000:1.0:1787829845.875647:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787829845.875656:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284093184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787829845.875691:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787829845.875730:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284093184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829845.875736:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787829845.875769:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f4c0780 x1874675284093184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829861 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829845.875792:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284093184:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787829845.875866:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b5955f480 x1874675284093056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829845.875879:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284093056:0@lo:400:kworker.0 00000100:00100000:1.0:1787829845.876011:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284092416 00000100:00100000:1.0:1787829845.876036:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284092416 00000100:00100000:0.0:1787829845.877272:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284092800:0@lo:400:kworker.0 00000100:00100000:0.0:1787829845.877564:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787829845.877594:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:0.0:1787829845.877610:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787829845.877617:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787829845.877621:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787829845.877752:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787829845.877767:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3280:x1874675284092416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829845.877879:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3280:x1874675284092416:12345-0@lo:400:kworker.0 Request processed in 117us (12258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829845.877887:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787829845.878306:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284092672:12345-0@lo:400:kworker.0 Request processed in 12005us (13038us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829845.878316:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787829845.878389:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b47a792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284092416:0@lo:400:kworker.0 00000100:00100000:2.0:1787829845.878419:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787829845.878430:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874675284092544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829845.878479:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874675284092544:12345-0@lo:400:kworker.0 Request processed in 53us (16161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829845.878486:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787829845.878520:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b47a79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874675284092544:0@lo:400:kworker.0 00000100:00100000:2.0:1787829845.878550:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284092672:0@lo:400:kworker.0 00000100:00100000:3.0:1787829845.882439:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874675284092928:12345-0@lo:400:kworker.0 Request processed in 13901us (16292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829845.882459:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787829845.882620:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1874675284092928:0@lo:400:kworker.0 00000100:00100000:1.0:1787829846.372533:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787829846.372566:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284093312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787829846.372680:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829846.373014:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284093312 00000100:00100000:3.0:1787829846.373067:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284093312 00000100:00100000:3.0:1787829846.373141:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787829846.373153:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284093312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787829846.373205:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787829846.373271:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284093312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829846.373279:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1787829846.373455:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b6fa4c3c0 x1874675284093312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829846.373478:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284093312:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787829846.692240:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787829847.093497:0:10081:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 07:24:05 (1787829845) === 00000100:00100000:2.0:1787829847.625322:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829847.625421:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275670912 00000100:00100000:3.0:1787829847.625435:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275670912 00000100:00100000:3.0:1787829847.625511:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 209 00000100:00100000:3.0:1787829847.625523:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:8151:x1874675275670912:12345-192.168.201.51@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787829847.625942:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829847.625970:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b596cb000/0xc03b4d103c0d78bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x53172783628c86c1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829847.626012:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b596cb000/0xc03b4d103c0d78bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c86c1 expref: 11 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829847.626066:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b596cb000/0xc03b4d103c0d78bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c86c1 expref: 11 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829847.626106:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b596cb000, rc 0) 00000100:00100000:3.0:1787829847.626195:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+11:8151:x1874675275670912:12345-192.168.201.51@tcp:101:mount.lustre.0 Request processed in 673us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829847.626204:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 209 00000100:00100000:0.0:1787829847.633442:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829847.633564:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275671040 00000100:00100000:2.0:1787829847.633588:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275671040 00000100:00100000:2.0:1787829847.633672:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 210 00000100:00100000:2.0:1787829847.633686:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+11:8151:x1874675275671040:12345-192.168.201.51@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787829847.634388:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+11:8151:x1874675275671040:12345-192.168.201.51@tcp:501:mount.lustre.0 Request processed in 702us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829847.634398:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 210 00000100:00100000:0.0:1787829847.636864:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829847.637138:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275671168 00000100:00100000:3.0:1787829847.637152:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275671168 00000100:00100000:3.0:1787829847.637223:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 211 00000100:00100000:3.0:1787829847.637234:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+11:8151:x1874675275671168:12345-192.168.201.51@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787829847.637545:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+11:8151:x1874675275671168:12345-192.168.201.51@tcp:503:mount.lustre.0 Request processed in 311us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829847.637555:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 211 00000100:00100000:3.0:1787829847.641609:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829847.641769:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275671296 00000100:00100000:2.0:1787829847.641781:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275671296 00000100:00100000:2.0:1787829847.641857:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 212 00000100:00100000:2.0:1787829847.641868:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+11:8155:x1874675275671296:12345-192.168.201.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787829847.642323:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+11:8155:x1874675275671296:12345-192.168.201.51@tcp:502:llog_process_th.0 Request processed in 454us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829847.642334:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 212 00000100:00100000:0.0:1787829847.660243:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829847.660352:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275671424 00000100:00100000:3.0:1787829847.660365:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275671424 00000100:00100000:3.0:1787829847.660435:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 213 00000100:00100000:3.0:1787829847.660448:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+11:8155:x1874675275671424:12345-192.168.201.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787829847.662256:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+11:8155:x1874675275671424:12345-192.168.201.51@tcp:502:llog_process_th.0 Request processed in 1791us (2009us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829847.662276:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 213 00000100:00100000:0.0:1787829847.676065:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829847.678195:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275671552 00000100:00100000:1.0:1787829847.678218:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275671552 00000100:00100000:1.0:1787829847.678395:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 214 00000100:00100000:1.0:1787829847.678409:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+11:8151:x1874675275671552:12345-192.168.201.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787829847.678431:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829847.678457:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d78c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x53172783628c86eb expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829847.678495:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d78c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c86eb expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829847.678507:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d78c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c86eb expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829847.678517:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b48cdac00, rc 0) 00000100:00100000:1.0:1787829847.678622:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+12:8151:x1874675275671552:12345-192.168.201.51@tcp:101:mount.lustre.0 Request processed in 211us (2609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829847.678630:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 214 00000100:00100000:0.0:1787829847.690968:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829847.691152:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275671680 00000100:00100000:3.0:1787829847.691168:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275671680 00000100:00100000:3.0:1787829847.691245:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 215 00000100:00100000:3.0:1787829847.691257:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+12:8151:x1874675275671680:12345-192.168.201.51@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787829847.691293:0:5800:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787829847.691334:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787829847.691339:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787829847.691343:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787829847.691345:0:5800:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787829847.693880:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+12:8151:x1874675275671680:12345-192.168.201.51@tcp:256:mount.lustre.0 Request processed in 2607us (2922us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829847.693903:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 215 00000100:00100000:0.0:1787829847.697099:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829847.697295:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275671808 00000100:00100000:1.0:1787829847.697308:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275671808 00000100:00100000:1.0:1787829847.697380:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 216 00000100:00100000:1.0:1787829847.697393:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+12:8151:x1874675275671808:12345-192.168.201.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787829847.697416:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829847.697440:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b48cda200/0xc03b4d103c0d78cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x53172783628c86f2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829847.697479:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b48cda200/0xc03b4d103c0d78cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c86f2 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829847.697516:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b48cda200/0xc03b4d103c0d78cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c86f2 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829847.697528:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b48cda200, rc 0) 00000100:00100000:1.0:1787829847.697617:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:8151:x1874675275671808:12345-192.168.201.51@tcp:101:mount.lustre.0 Request processed in 227us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829847.697626:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 216 00000100:00100000:0.0:1787829847.700363:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829847.700472:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275671936 00000100:00100000:3.0:1787829847.700485:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275671936 00000100:00100000:3.0:1787829847.700551:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 217 00000100:00100000:3.0:1787829847.700562:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:8151:x1874675275671936:12345-192.168.201.51@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787829847.700964:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:8151:x1874675275671936:12345-192.168.201.51@tcp:501:mount.lustre.0 Request processed in 402us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829847.700973:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 217 00000100:00100000:0.0:1787829847.704006:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829847.704681:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275672064 00000100:00100000:2.0:1787829847.704695:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275672064 00000100:00100000:3.0:1787829847.704938:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 218 00000100:00100000:3.0:1787829847.704967:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:8151:x1874675275672064:12345-192.168.201.51@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787829847.705335:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:8151:x1874675275672064:12345-192.168.201.51@tcp:503:mount.lustre.0 Request processed in 384us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829847.705344:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 218 00000100:00100000:0.0:1787829847.709324:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829847.709447:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275672192 00000100:00100000:1.0:1787829847.709462:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275672192 00000100:00100000:1.0:1787829847.709675:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 219 00000100:00100000:1.0:1787829847.709692:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:8160:x1874675275672192:12345-192.168.201.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787829847.710398:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:8160:x1874675275672192:12345-192.168.201.51@tcp:502:llog_process_th.0 Request processed in 706us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829847.710410:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 219 00010000:00010000:1.0:1787829847.717110:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829847.722408:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829847.722559:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275672320 00000100:00100000:3.0:1787829847.722583:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275672320 00000100:00100000:3.0:1787829847.722781:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 220 00000100:00100000:3.0:1787829847.722794:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:8160:x1874675275672320:12345-192.168.201.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787829847.723190:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:8160:x1874675275672320:12345-192.168.201.51@tcp:502:llog_process_th.0 Request processed in 397us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829847.723200:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 220 00000100:00100000:0.0:1787829847.732995:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829847.733093:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829847.733176:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275672576 00000100:00100000:2.0:1787829847.733189:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275672576 00000100:00100000:3.0:1787829847.733250:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275672448 00000100:00100000:3.0:1787829847.733255:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275672448 00000100:00100000:2.0:1787829847.733278:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 64 00000100:00080000:0.0:1787829847.733321:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787829847.733365:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:2363:x1874675275672576:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829847.733470:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:2363:x1874675275672576:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 113us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829847.736762:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 10 00000100:00100000:3.0:1787829847.736784:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2359:x1874675275672448:12345-192.168.201.51@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787829847.736838:0:5805:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 902200d4-578b-4474-a651-ffe6603128fa@192.168.201.51@tcp t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:3.0:1787829847.736896:0:5805:0:(genops.c:1385:class_connect()) connect: client 902200d4-578b-4474-a651-ffe6603128fa, cookie 0xc03b4d103c0d78d4 00000004:00100000:3.0:1787829847.736941:0:5805:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:3.0:1787829847.737461:0:5805:0:(import.c:65:import_set_state_nolock()) ffff9e9b74f2c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787829847.737671:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:902200d4-578b-4474-a651-ffe6603128fa+6:2359:x1874675275672448:12345-192.168.201.51@tcp:38:mount.lustre.0 Request processed in 890us (4576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829847.737682:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 10 00000100:00100000:2.0:1787829847.737704:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 64 00000100:00100000:1.0:1787829847.741987:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829847.742061:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829847.742136:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275672832 00000100:00100000:0.0:1787829847.742136:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275672704 00000100:00100000:0.0:1787829847.742150:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275672704 00000100:00100000:3.0:1787829847.742213:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275672832 00000100:00100000:0.0:1787829847.742285:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 11 00000100:00100000:0.0:1787829847.742297:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:902200d4-578b-4474-a651-ffe6603128fa+7:0:x1874675275672704:12345-192.168.201.51@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787829847.742357:0:5804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787829847.742468:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:902200d4-578b-4474-a651-ffe6603128fa+7:0:x1874675275672704:12345-192.168.201.51@tcp:41:mount.lustre.0 Request processed in 173us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829847.742497:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 11 00000100:00100000:0.0:1787829847.742519:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 12 00000100:00100000:0.0:1787829847.742525:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:902200d4-578b-4474-a651-ffe6603128fa+6:8151:x1874675275672832:12345-192.168.201.51@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787829847.742536:0:5804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787829847.742561:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:902200d4-578b-4474-a651-ffe6603128fa+6:8151:x1874675275672832:12345-192.168.201.51@tcp:41:mount.lustre.0 Request processed in 36us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829847.742579:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 12 00000100:00100000:3.0:1787829847.745124:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829847.745276:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275672960 00000100:00100000:2.0:1787829847.745288:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275672960 00000100:00100000:2.0:1787829847.745365:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 13 00000100:00100000:2.0:1787829847.745376:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:902200d4-578b-4474-a651-ffe6603128fa+6:8151:x1874675275672960:12345-192.168.201.51@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787829847.745492:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:902200d4-578b-4474-a651-ffe6603128fa+6:8151:x1874675275672960:12345-192.168.201.51@tcp:40:mount.lustre.0 Request processed in 118us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829847.745501:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 13 00000100:00100000:0.0:1787829847.748720:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829847.748768:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829847.748882:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275673344 00000100:00100000:3.0:1787829847.748894:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275673344 00000100:00100000:3.0:1787829847.748985:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 1 00000100:00100000:3.0:1787829847.748998:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:902200d4-578b-4474-a651-ffe6603128fa+6:8151:x1874675275673344:12345-192.168.201.51@tcp:33:mount.lustre.0 00000100:00100000:0.0:1787829847.750944:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00080000:1.0:1787829847.751404:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787829847.752178:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275673088 00000100:00100000:2.0:1787829847.752191:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275673088 00000004:00200000:0.0:1787829847.752543:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787829847.752758:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:902200d4-578b-4474-a651-ffe6603128fa+6:8151:x1874675275673344:12345-192.168.201.51@tcp:33:mount.lustre.0 Request processed in 3756us (4046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829847.752776:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 1 00000100:00100000:1.0:1787829847.756477:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275673216 00000100:00100000:1.0:1787829847.756498:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275673216 00000100:00100000:1.0:1787829847.756584:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 12 00000100:00100000:1.0:1787829847.756595:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2359:x1874675275673088:12345-192.168.201.51@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787829847.756645:0:6650:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 902200d4-578b-4474-a651-ffe6603128fa@192.168.201.51@tcp t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:1.0:1787829847.756699:0:6650:0:(genops.c:1385:class_connect()) connect: client 902200d4-578b-4474-a651-ffe6603128fa, cookie 0xc03b4d103c0d78db 00002000:00100000:1.0:1787829847.756734:0:6650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 902200d4-578b-4474-a651-ffe6603128fa/ffff9e9b75da4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787829847.756768:0:6650:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1787829847.757132:0:6650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787829847.757177:0:6650:0:(import.c:65:import_set_state_nolock()) ffff9e9b75da2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787829847.757270:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:902200d4-578b-4474-a651-ffe6603128fa+6:2359:x1874675275673088:12345-192.168.201.51@tcp:8:mount.lustre.0 Request processed in 675us (8499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829847.757280:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 12 00000100:00100000:1.0:1787829847.757302:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 13 00000100:00100000:1.0:1787829847.757307:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2359:x1874675275673216:12345-192.168.201.51@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787829847.757325:0:6650:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 902200d4-578b-4474-a651-ffe6603128fa@192.168.201.51@tcp t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:1.0:1787829847.757342:0:6650:0:(genops.c:1385:class_connect()) connect: client 902200d4-578b-4474-a651-ffe6603128fa, cookie 0xc03b4d103c0d78e2 00002000:00100000:1.0:1787829847.757349:0:6650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 902200d4-578b-4474-a651-ffe6603128fa/ffff9e9b75da2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787829847.757357:0:6650:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1787829847.757503:0:6650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787829847.757519:0:6650:0:(import.c:65:import_set_state_nolock()) ffff9e9b75da0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787829847.757543:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:902200d4-578b-4474-a651-ffe6603128fa+6:2359:x1874675275673216:12345-192.168.201.51@tcp:8:mount.lustre.0 Request processed in 234us (6614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829847.757550:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 13 00010000:00010000:3.0:1787829848.738199:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787829849.567521:0:5827:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 902200d4-578b-4474-a651-ffe6603128fa 00010000:00010000:1.0:1787829849.764851:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787829850.023126:0:7602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 902200d4-578b-4474-a651-ffe6603128fa 00010000:00010000:3.0:1787829850.786146:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787829850.983823:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874675284093568:0@lo:400:kworker.0 00000100:00100000:2.0:1787829850.983897:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829850.983952:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284094080:0@lo:400:kworker.0 00000100:00100000:2.0:1787829850.983991:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829850.984065:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787829850.984071:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3281:1874675284093440:0@lo:400:kworker.0 00000100:00100000:2.0:1787829850.984102:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829850.984123:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1874675284093952:0@lo:400:kworker.0 00000100:00100000:2.0:1787829850.984144:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829850.984173:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284093568 00000100:00100000:2.0:1787829850.984181:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284093568 00000100:00100000:2.0:1787829850.984223:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284093952 00000100:00100000:2.0:1787829850.984226:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284093952 00000100:00100000:2.0:1787829850.984256:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787829850.984265:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874675284093568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829850.984308:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874675284093568:12345-0@lo:400:kworker.0 Request processed in 45us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829850.984314:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787829850.984330:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787829850.984336:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874675284093952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829850.984362:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874675284093952:12345-0@lo:400:kworker.0 Request processed in 27us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829850.984368:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787829850.984403:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1874675284093952:0@lo:400:kworker.0 00000100:00100000:2.0:1787829850.984409:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874675284093568:0@lo:400:kworker.0 00000100:00100000:0.0:1787829850.985720:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284093696:0@lo:400:kworker.0 00000100:00100000:0.0:1787829850.985771:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829850.985809:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787829850.985816:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284093824:0@lo:400:kworker.0 00000100:00100000:0.0:1787829850.985841:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829850.985875:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284093696 00000100:00100000:0.0:1787829850.985880:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284093696 00000100:00100000:0.0:1787829850.985921:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787829850.985928:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284093696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829850.985982:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284093696:12345-0@lo:400:kworker.0 Request processed in 44us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829850.985999:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787829850.986044:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284094080 00000100:00100000:0.0:1787829850.986048:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284094080 00000100:00100000:0.0:1787829850.986075:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284093824 00000100:00100000:0.0:1787829850.986078:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284093824 00000100:00100000:0.0:1787829850.986103:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787829850.986109:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284094080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829850.986149:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284094080:12345-0@lo:400:kworker.0 Request processed in 40us (2158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829850.986156:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787829850.986167:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787829850.986172:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284093824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829850.986198:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284093824:12345-0@lo:400:kworker.0 Request processed in 26us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829850.986203:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1787829850.986239:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9a424f2580 x1874675284093824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829850.986252:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284093824:0@lo:400:kworker.0 00000100:00100000:0.0:1787829850.986264:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284093696:0@lo:400:kworker.0 00010000:00080000:0.0:1787829850.986300:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9a424f0780 x1874675284094080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829850.986308:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284094080:0@lo:400:kworker.0 00000100:00100000:0.0:1787829850.986580:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284093440 00000100:00100000:0.0:1787829850.986586:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284093440 00000100:00100000:0.0:1787829850.986622:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787829850.986629:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3281:x1874675284093440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829850.986668:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3281:x1874675284093440:12345-0@lo:400:kworker.0 Request processed in 40us (2565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829850.986675:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787829850.986714:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3281:1874675284093440:0@lo:400:kworker.0 00000100:00080000:0.0:1787829850.986738:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787829850.986744:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787829850.986746:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787829850.994181:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787829850.994206:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fef5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284094208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787829850.994286:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829850.997097:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284094208 00000100:00100000:3.0:1787829850.997108:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284094208 00000100:00100000:3.0:1787829850.997208:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787829850.997218:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284094208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787829850.997251:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787829850.997339:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284094208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (3053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829850.997347:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1787829850.997412:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7fef5a40 x1874675284094208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829850.997432:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fef5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284094208:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1787829851.042608:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 902200d4-578b-4474-a651-ffe6603128fa 00000100:00100000:2.0:1787829851.499153:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284094336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787829851.499231:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829851.500186:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284094336 00000100:00100000:3.0:1787829851.500196:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284094336 00000100:00100000:3.0:1787829851.500600:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787829851.500612:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284094336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787829851.500653:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787829851.500726:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284094336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829851.500734:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1787829851.501057:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9a424f3480 x1874675284094336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829851.501081:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284094336:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787829851.810540:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829852.834546:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829852.978009:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829852.978084:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829852.978112:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829852.978130:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829852.978168:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829852.978347:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275673600 00000100:00100000:0.0:1787829852.978358:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275673600 00000100:00100000:0.0:1787829852.978430:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275673728 00000100:00100000:0.0:1787829852.978434:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275673728 00000100:00100000:0.0:1787829852.978458:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 68 00000100:00100000:0.0:1787829852.978468:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+6:2361:x1874675275673600:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787829852.978547:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+6:2361:x1874675275673600:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 80us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829852.978555:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 68 00000100:00100000:0.0:1787829852.978572:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 69 00000100:00100000:0.0:1787829852.978579:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:902200d4-578b-4474-a651-ffe6603128fa+5:2361:x1874675275673728:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787829852.978602:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:902200d4-578b-4474-a651-ffe6603128fa+5:2361:x1874675275673728:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 24us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829852.978618:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 69 00000100:00100000:0.0:1787829852.978637:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275673856 00000100:00100000:0.0:1787829852.978641:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275673856 00000100:00100000:0.0:1787829852.978665:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275673984 00000100:00100000:0.0:1787829852.978668:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275673984 00000100:00100000:0.0:1787829852.978686:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 29 00000100:00100000:0.0:1787829852.978692:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:902200d4-578b-4474-a651-ffe6603128fa+5:2361:x1874675275673856:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787829852.978719:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:902200d4-578b-4474-a651-ffe6603128fa+5:2361:x1874675275673856:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 27us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829852.978725:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 29 00000100:00100000:0.0:1787829852.978736:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 30 00000100:00100000:0.0:1787829852.978743:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ebc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:902200d4-578b-4474-a651-ffe6603128fa+5:2361:x1874675275673984:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787829852.978781:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ebc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:902200d4-578b-4474-a651-ffe6603128fa+5:2361:x1874675275673984:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 38us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829852.978787:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 30 00000100:00100000:0.0:1787829852.978804:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275673472 00000100:00100000:0.0:1787829852.978807:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275673472 00000100:00100000:0.0:1787829852.978826:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 222 00000100:00100000:0.0:1787829852.978832:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2361:x1874675275673472:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787829852.978855:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2361:x1874675275673472:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 23us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829852.978860:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 222 00000100:00080000:1.0:1787829852.979790:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787829852.979796:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787829852.979798:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1787829853.839938:0:10280:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg151-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1787829853.858448:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829854.882164:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829855.908679:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829856.102285:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284094464:0@lo:400:kworker.0 00000100:00100000:1.0:1787829856.102378:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829856.102428:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1874675284094976:0@lo:400:kworker.0 00000100:00100000:1.0:1787829856.102456:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829856.102484:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787829856.102490:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874675284094592:0@lo:400:kworker.0 00000100:00100000:1.0:1787829856.102511:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829856.102529:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284095104:0@lo:400:kworker.0 00000100:00100000:1.0:1787829856.102551:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829856.102586:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284094464 00000100:00100000:1.0:1787829856.102594:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284094464 00000100:00100000:1.0:1787829856.102639:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787829856.102648:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3280:x1874675284094464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829856.102696:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3280:x1874675284094464:12345-0@lo:400:kworker.0 Request processed in 49us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829856.102703:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787829856.102734:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284094976 00000100:00100000:1.0:1787829856.102738:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284094976 00000100:00100000:1.0:1787829856.102773:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284094592 00000100:00100000:1.0:1787829856.102776:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284094592 00000100:00100000:1.0:1787829856.102797:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787829856.102804:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874675284094976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829856.102852:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874675284094976:12345-0@lo:400:kworker.0 Request processed in 48us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829856.102858:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787829856.102870:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787829856.102876:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874675284094592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829856.102914:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874675284094592:12345-0@lo:400:kworker.0 Request processed in 38us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829856.102920:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787829856.102942:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284095104 00000100:00100000:1.0:1787829856.102945:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284095104 00000100:00100000:1.0:1787829856.102974:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787829856.102981:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284095104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829856.103011:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284095104:12345-0@lo:400:kworker.0 Request processed in 31us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829856.103049:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787829856.103067:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787829856.103071:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787829856.103107:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874675284094592:0@lo:400:kworker.0 00010000:00080000:1.0:1787829856.103121:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f4d61c0 x1874675284095104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829856.103131:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284095104:0@lo:400:kworker.0 00000100:00100000:1.0:1787829856.103140:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284094464:0@lo:400:kworker.0 00000100:00100000:1.0:1787829856.103150:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1874675284094976:0@lo:400:kworker.0 00000100:00100000:1.0:1787829856.103290:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284094720:0@lo:400:kworker.0 00000100:00100000:1.0:1787829856.103324:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829856.103344:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787829856.103350:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284094848:0@lo:400:kworker.0 00000100:00100000:1.0:1787829856.103372:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829856.103396:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284094848 00000100:00100000:1.0:1787829856.103399:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284094848 00000100:00100000:1.0:1787829856.103431:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787829856.103437:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284094848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829856.103472:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284094848:12345-0@lo:400:kworker.0 Request processed in 35us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829856.103478:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787829856.103494:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787829856.103510:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f4d7840 x1874675284094848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829856.103520:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284094848:0@lo:400:kworker.0 00000100:00100000:1.0:1787829856.103545:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284094720 00000100:00100000:1.0:1787829856.103548:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284094720 00000100:00100000:1.0:1787829856.103574:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787829856.103580:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284094720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829856.103614:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284094720:12345-0@lo:400:kworker.0 Request processed in 34us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829856.103620:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1787829856.103634:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787829856.103650:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284094720:0@lo:400:kworker.0 00000100:00100000:0.0:1787829856.105855:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284095232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787829856.105930:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829856.106042:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284095232 00000100:00100000:1.0:1787829856.106050:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284095232 00000100:00100000:1.0:1787829856.106101:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787829856.106110:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284095232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787829856.106145:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787829856.106189:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284095232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829856.106197:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787829856.106291:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f4d6940 x1874675284095232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829856.106307:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284095232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787829856.612373:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787829856.612395:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284095360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787829856.612459:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829856.612573:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284095360 00000100:00100000:2.0:1787829856.612582:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284095360 00000100:00100000:2.0:1787829856.612641:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787829856.612650:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284095360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787829856.612689:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787829856.612738:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284095360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829856.612745:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1787829856.612782:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9a424f0b40 x1874675284095360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829856.612800:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284095360:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787829856.930192:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829857.954446:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787829858.079763:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829858.079807:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829858.079831:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829858.079863:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829858.079898:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829858.079928:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275674368 00000100:00100000:3.0:1787829858.079942:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275674368 00000100:00100000:3.0:1787829858.079993:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275674240 00000100:00100000:3.0:1787829858.079996:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275674240 00000100:00100000:3.0:1787829858.080047:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 73 00000100:00100000:3.0:1787829858.080058:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f381e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:902200d4-578b-4474-a651-ffe6603128fa+5:2363:x1874675275674368:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829858.080131:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f381e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:902200d4-578b-4474-a651-ffe6603128fa+5:2363:x1874675275674368:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 75us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829858.080139:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 73 00000100:00100000:3.0:1787829858.080157:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 74 00000100:00100000:3.0:1787829858.080163:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5455a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+6:2363:x1874675275674240:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829858.080188:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5455a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+6:2363:x1874675275674240:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 25us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829858.080194:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 74 00000100:00100000:3.0:1787829858.080212:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275674624 00000100:00100000:3.0:1787829858.080215:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275674624 00000100:00100000:3.0:1787829858.080240:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275674496 00000100:00100000:3.0:1787829858.080243:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275674496 00000100:00100000:3.0:1787829858.080264:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 33 00000100:00100000:3.0:1787829858.080270:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:902200d4-578b-4474-a651-ffe6603128fa+5:2363:x1874675275674624:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829858.080293:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:902200d4-578b-4474-a651-ffe6603128fa+5:2363:x1874675275674624:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 24us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829858.080300:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 33 00000100:00100000:3.0:1787829858.080310:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 34 00000100:00100000:3.0:1787829858.080315:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:902200d4-578b-4474-a651-ffe6603128fa+5:2363:x1874675275674496:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829858.080335:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:902200d4-578b-4474-a651-ffe6603128fa+5:2363:x1874675275674496:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 20us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829858.080349:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 34 00000100:00080000:3.0:1787829858.080372:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787829858.080375:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787829858.080378:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787829858.081312:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275674112 00000100:00100000:1.0:1787829858.081320:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275674112 00000100:00100000:1.0:1787829858.081359:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 224 00000100:00100000:1.0:1787829858.081365:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2363:x1874675275674112:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829858.081412:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2363:x1874675275674112:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 48us (1660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829858.081419:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 224 00010000:00010000:3.0:1787829858.980259:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829860.003180:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829861.027224:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787829861.218724:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284095872:0@lo:400:kworker.0 00000100:00100000:2.0:1787829861.218810:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829861.218883:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787829861.218890:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284096000:0@lo:400:kworker.0 00000100:00100000:2.0:1787829861.218919:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829861.218960:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284096000 00000100:00100000:2.0:1787829861.218968:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284096000 00000100:00100000:2.0:1787829861.219040:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787829861.219051:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f545680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284096000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829861.219103:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f545680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284096000:12345-0@lo:400:kworker.0 Request processed in 55us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829861.219110:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1787829861.219131:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787829861.219162:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9a424f2580 x1874675284096000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829861.219195:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284096000:0@lo:400:kworker.0 00000100:00100000:3.0:1787829861.220659:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874675284095744:0@lo:400:kworker.0 00000100:00100000:3.0:1787829861.220715:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829861.220904:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b47a79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284096256:0@lo:400:kworker.0 00000100:00100000:3.0:1787829861.220932:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829861.221405:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284095872 00000100:00100000:0.0:1787829861.221414:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284095872 00000100:00100000:0.0:1787829861.221472:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284095744 00000100:00100000:0.0:1787829861.221475:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284095744 00000100:00100000:0.0:1787829861.221497:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787829861.221507:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b47a792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284095872:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787829861.221606:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787829861.221680:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b47a792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284095872:12345-0@lo:400:kworker.0 Request processed in 175us (2869us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829861.221688:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787829861.221704:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787829861.221710:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874675284095744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829861.221789:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284095872:0@lo:400:kworker.0 00000100:00100000:2.0:1787829861.224424:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284096256 00000100:00100000:2.0:1787829861.224437:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284096256 00000100:00100000:2.0:1787829861.224498:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787829861.224509:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284096256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829861.224607:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284096256:12345-0@lo:400:kworker.0 Request processed in 100us (3674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829861.224615:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787829861.224642:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284095488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787829861.224679:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829861.224714:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284095616:0@lo:400:kworker.0 00000100:00100000:2.0:1787829861.224740:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829861.224762:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1874675284096128:0@lo:400:kworker.0 00000100:00100000:2.0:1787829861.224786:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829861.224832:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284095488 00000100:00100000:2.0:1787829861.224836:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284095488 00000100:00100000:2.0:1787829861.224863:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787829861.224880:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f545a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284095488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787829861.224912:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787829861.224949:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f545a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284095488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829861.224955:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787829861.224982:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284095616 00000100:00100000:2.0:1787829861.224986:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284095616 00000100:00100000:2.0:1787829861.225011:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787829861.225037:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3280:x1874675284095616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829861.225068:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3280:x1874675284095616:12345-0@lo:400:kworker.0 Request processed in 51us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829861.225074:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:2.0:1787829861.225277:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787829861.225305:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f4d4b40 x1874675284095488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829861.225323:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284095488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787829861.225332:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284095616:0@lo:400:kworker.0 00000100:00100000:3.0:1787829861.226660:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284096128 00000100:00100000:3.0:1787829861.226671:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284096128 00000100:00100000:3.0:1787829861.226728:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787829861.226738:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874675284096128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829861.226824:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874675284096128:12345-0@lo:400:kworker.0 Request processed in 87us (2036us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829861.226830:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1787829861.226864:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787829861.226970:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1874675284096128:0@lo:400:kworker.0 00000100:00100000:0.0:1787829861.227266:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874675284095744:12345-0@lo:400:kworker.0 Request processed in 5554us (6548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829861.227275:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787829861.227611:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874675284095744:0@lo:400:kworker.0 00010000:00080000:3.0:1787829861.227627:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b47a79e00 x1874675284096256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829861.227638:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b47a79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284096256:0@lo:400:kworker.0 00000100:00100000:1.0:1787829861.735097:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787829861.735122:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fec5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284096384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787829861.735200:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829861.735520:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284096384 00000100:00100000:3.0:1787829861.735529:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284096384 00000100:00100000:3.0:1787829861.735596:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787829861.735605:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284096384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787829861.735643:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787829861.735695:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284096384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829861.735702:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1787829861.735741:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7fec5a40 x1874675284096384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829861.735760:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fec5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284096384:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787829862.051417:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829863.074182:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829863.199529:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829863.199568:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829863.199597:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829863.199632:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275674752 00000100:00100000:1.0:1787829863.199642:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275674752 00000100:00100000:1.0:1787829863.199687:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 226 00000100:00100000:1.0:1787829863.199697:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2362:x1874675275674752:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829863.199780:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2362:x1874675275674752:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 83us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829863.199789:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 226 00000100:00100000:1.0:1787829863.199837:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275675008 00000100:00100000:1.0:1787829863.199840:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275675008 00000100:00100000:1.0:1787829863.199883:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 78 00000100:00100000:1.0:1787829863.199890:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:902200d4-578b-4474-a651-ffe6603128fa+5:2362:x1874675275675008:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829863.199923:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:902200d4-578b-4474-a651-ffe6603128fa+5:2362:x1874675275675008:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 33us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829863.199929:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 78 00000100:00080000:1.0:1787829863.200070:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787829863.200501:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275675264 00000100:00100000:2.0:1787829863.200506:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275675264 00000100:00100000:2.0:1787829863.200557:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 37 00000100:00100000:2.0:1787829863.200567:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:902200d4-578b-4474-a651-ffe6603128fa+5:2362:x1874675275675264:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829863.200606:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:902200d4-578b-4474-a651-ffe6603128fa+5:2362:x1874675275675264:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 42us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829863.200613:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 37 00000100:00080000:1.0:1787829863.205697:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787829863.220754:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829863.220832:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829863.220924:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275675136 00000100:00100000:2.0:1787829863.220936:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275675136 00000100:00100000:2.0:1787829863.221044:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 38 00000100:00100000:2.0:1787829863.221056:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:902200d4-578b-4474-a651-ffe6603128fa+5:2363:x1874675275675136:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829863.221124:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:902200d4-578b-4474-a651-ffe6603128fa+5:2363:x1874675275675136:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 72us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829863.221145:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 38 00000100:00080000:1.0:1787829863.221206:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787829863.221525:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275674880 00000100:00100000:3.0:1787829863.221530:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275674880 00000100:00100000:3.0:1787829863.221620:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 79 00000100:00100000:3.0:1787829863.221628:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:2363:x1874675275674880:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829863.221662:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:2363:x1874675275674880:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 36us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829863.221668:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 79 00000100:00080000:1.0:1787829863.221809:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787829864.098286:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829865.122165:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829866.147272:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787829866.341233:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284096512:0@lo:400:kworker.0 00000100:00100000:2.0:1787829866.341310:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829866.341359:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b596921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1874675284097024:0@lo:400:kworker.0 00000100:00100000:2.0:1787829866.341386:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829866.341413:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787829866.341419:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284096896:0@lo:400:kworker.0 00000100:00100000:2.0:1787829866.341445:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829866.341480:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284096512 00000100:00100000:2.0:1787829866.341487:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284096512 00000100:00100000:2.0:1787829866.341537:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787829866.341547:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3279:x1874675284096512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829866.341605:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3279:x1874675284096512:12345-0@lo:400:kworker.0 Request processed in 59us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829866.341611:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787829866.341646:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284097024 00000100:00100000:2.0:1787829866.341650:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284097024 00000100:00100000:2.0:1787829866.341685:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787829866.341692:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ed0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1874675284097024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829866.341737:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ed0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1874675284097024:12345-0@lo:400:kworker.0 Request processed in 46us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829866.341743:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787829866.341759:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284096896 00000100:00100000:2.0:1787829866.341763:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284096896 00000100:00100000:2.0:1787829866.341803:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787829866.341809:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ed30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284096896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829866.341841:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ed30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284096896:12345-0@lo:400:kworker.0 Request processed in 32us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829866.341847:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1787829866.341865:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787829866.341869:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787829866.341900:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9a424f3480 x1874675284096896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829866.341914:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284096896:0@lo:400:kworker.0 00000100:00100000:2.0:1787829866.341925:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284096512:0@lo:400:kworker.0 00000100:00100000:2.0:1787829866.341933:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b596921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1874675284097024:0@lo:400:kworker.0 00000100:00100000:3.0:1787829866.349150:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874675284096640:0@lo:400:kworker.0 00000100:00100000:3.0:1787829866.349230:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829866.349262:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284097152:0@lo:400:kworker.0 00000100:00100000:3.0:1787829866.349287:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829866.349315:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787829866.349322:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284096768:0@lo:400:kworker.0 00000100:00100000:3.0:1787829866.349345:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829866.349374:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284097280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787829866.349399:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829866.349434:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284097152 00000100:00100000:3.0:1787829866.349442:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284097152 00000100:00100000:3.0:1787829866.349609:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787829866.349619:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284097152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829866.349672:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284097152:12345-0@lo:400:kworker.0 Request processed in 55us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829866.349679:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787829866.349762:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284096640 00000100:00100000:3.0:1787829866.349767:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284096640 00000100:00100000:3.0:1787829866.349793:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284096768 00000100:00100000:3.0:1787829866.349796:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284096768 00000100:00100000:3.0:1787829866.349822:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787829866.349829:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874675284096640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829866.349859:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874675284096640:12345-0@lo:400:kworker.0 Request processed in 32us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829866.349865:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787829866.349876:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787829866.349881:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284096768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829866.349904:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284096768:12345-0@lo:400:kworker.0 Request processed in 24us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829866.349910:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787829866.349925:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284097280 00000100:00100000:3.0:1787829866.349928:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284097280 00000100:00100000:3.0:1787829866.349952:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787829866.349958:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284097280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787829866.349997:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787829866.350058:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284097280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829866.350065:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1787829866.350091:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787829866.350096:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787829866.350223:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284096768:0@lo:400:kworker.0 00010000:00080000:3.0:1787829866.350239:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f4d4b40 x1874675284097280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829866.350256:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284097280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787829866.350267:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874675284096640:0@lo:400:kworker.0 00010000:00080000:3.0:1787829866.350276:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b48ed21c0 x1874675284097152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829866.350284:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284097152:0@lo:400:kworker.0 00000100:00100000:3.0:1787829866.851427:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fec4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284097408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787829866.851551:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829866.852827:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284097408 00000100:00100000:3.0:1787829866.852840:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284097408 00000100:00100000:3.0:1787829866.852907:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787829866.852918:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284097408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787829866.852972:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787829866.854259:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284097408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1333us (2699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829866.854273:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1787829866.854853:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7fec4780 x1874675284097408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829866.854891:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fec4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284097408:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787829867.176281:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829868.195780:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829868.328739:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829868.328783:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829868.328816:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829868.328840:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829868.328865:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829868.328892:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275675648 00000100:00100000:1.0:1787829868.328902:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275675648 00000100:00100000:1.0:1787829868.328961:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275675520 00000100:00100000:1.0:1787829868.328979:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275675520 00000100:00100000:1.0:1787829868.329006:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 83 00000100:00100000:1.0:1787829868.329041:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:902200d4-578b-4474-a651-ffe6603128fa+5:2363:x1874675275675648:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829868.329109:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:902200d4-578b-4474-a651-ffe6603128fa+5:2363:x1874675275675648:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 95us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829868.329117:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 83 00000100:00100000:1.0:1787829868.329145:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 84 00000100:00100000:1.0:1787829868.329152:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:2363:x1874675275675520:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829868.329179:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:2363:x1874675275675520:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 28us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829868.329185:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 84 00000100:00080000:1.0:1787829868.329202:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787829868.329529:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275675392 00000100:00100000:2.0:1787829868.329534:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275675392 00000100:00100000:2.0:1787829868.329579:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 228 00000100:00100000:2.0:1787829868.329587:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2363:x1874675275675392:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829868.329619:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2363:x1874675275675392:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 35us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829868.329625:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 228 00000100:00100000:2.0:1787829868.329652:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275675776 00000100:00100000:2.0:1787829868.329655:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275675776 00000100:00100000:2.0:1787829868.329695:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275675904 00000100:00100000:2.0:1787829868.329698:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275675904 00000100:00100000:2.0:1787829868.329720:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 14 00000100:00100000:2.0:1787829868.329727:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:902200d4-578b-4474-a651-ffe6603128fa+5:2359:x1874675275675776:12345-192.168.201.51@tcp:9:kworker.0 00000020:00000080:2.0:1787829868.329757:0:8603:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d78db 00000100:00080000:2.0:1787829868.329767:0:8603:0:(import.c:65:import_set_state_nolock()) ffff9e9b75da2000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787829868.329803:0:8603:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787829868.330142:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:902200d4-578b-4474-a651-ffe6603128fa+2:2359:x1874675275675776:12345-192.168.201.51@tcp:9:kworker.0 Request processed in 415us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829868.330150:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 14 00000100:00100000:2.0:1787829868.330163:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 15 00000100:00100000:2.0:1787829868.330170:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7a4b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:902200d4-578b-4474-a651-ffe6603128fa+5:2359:x1874675275675904:12345-192.168.201.51@tcp:9:kworker.0 00000020:00000080:2.0:1787829868.330182:0:8603:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d78e2 00000100:00080000:2.0:1787829868.330189:0:8603:0:(import.c:65:import_set_state_nolock()) ffff9e9b75da0800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787829868.330211:0:8603:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787829868.330402:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7a4b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:902200d4-578b-4474-a651-ffe6603128fa+2:2359:x1874675275675904:12345-192.168.201.51@tcp:9:kworker.0 Request processed in 226us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829868.330410:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 15 00010000:00010000:2.0:1787829868.330651:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829868.330657:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787829868.330664:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787829868.330680:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787829869.221409:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829870.242901:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787829870.569769:0:7602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 902200d4-578b-4474-a651-ffe6603128fa 00000020:00000080:3.0:1787829870.569781:0:7602:0:(genops.c:885:class_export_put()) final put ffff9e9b75da2800/902200d4-578b-4474-a651-ffe6603128fa 00000020:00000080:3.0:1787829870.569817:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b75da2800/902200d4-578b-4474-a651-ffe6603128fa for lustre-OST0001 00000020:00000080:3.0:1787829870.569878:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b75da0800 for lustre-OST0001 00010000:00010000:2.0:1787829871.266767:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787829871.462535:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787829871.462570:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fef7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284097536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787829871.462677:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829871.462934:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284097536 00000100:00100000:0.0:1787829871.462945:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284097536 00000100:00100000:0.0:1787829871.463050:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787829871.463063:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ed1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284097536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787829871.463113:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787829871.463176:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ed1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284097536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829871.463204:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1787829871.463453:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787829871.463491:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7fef7c00 x1874675284097536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829871.463861:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fef7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284097536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787829871.464074:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787829871.464087:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fec52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3281:1874675284097664:0@lo:400:kworker.0 00000100:00100000:3.0:1787829871.464141:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829871.464202:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fec43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874675284097792:0@lo:400:kworker.0 00000100:00100000:3.0:1787829871.464230:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829871.465403:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284097664 00000100:00100000:2.0:1787829871.465415:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284097664 00000100:00100000:2.0:1787829871.465472:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787829871.465482:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3281:x1874675284097664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829871.465646:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3281:x1874675284097664:12345-0@lo:400:kworker.0 Request processed in 164us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829871.465656:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787829871.465699:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284097792 00000100:00100000:2.0:1787829871.465704:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284097792 00000100:00100000:2.0:1787829871.465810:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787829871.465818:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874675284097792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829871.465854:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874675284097792:12345-0@lo:400:kworker.0 Request processed in 38us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829871.465860:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787829871.465920:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fec43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874675284097792:0@lo:400:kworker.0 00000100:00100000:2.0:1787829871.465930:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fec52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3281:1874675284097664:0@lo:400:kworker.0 00000100:00100000:2.0:1787829871.466011:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284097920:0@lo:400:kworker.0 00000100:00100000:2.0:1787829871.466079:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829871.466118:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284097920 00000100:00100000:2.0:1787829871.466123:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284097920 00000100:00100000:2.0:1787829871.466160:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787829871.466167:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ed0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284097920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829871.466205:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ed0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284097920:12345-0@lo:400:kworker.0 Request processed in 39us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829871.466211:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1787829871.466243:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787829871.469800:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284097920:0@lo:400:kworker.0 00000100:00100000:2.0:1787829871.469907:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1874675284098048:0@lo:400:kworker.0 00000100:00100000:2.0:1787829871.469990:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829871.470092:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284098176:0@lo:400:kworker.0 00000100:00100000:2.0:1787829871.470122:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829871.470157:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284098176 00000100:00100000:2.0:1787829871.470164:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284098176 00000100:00100000:2.0:1787829871.470230:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787829871.470241:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284098176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829871.470313:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284098176:12345-0@lo:400:kworker.0 Request processed in 74us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829871.470323:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1787829871.470351:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787829871.470375:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b6fa4f0c0 x1874675284098176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829871.470388:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284098176:0@lo:400:kworker.0 00000100:00100000:2.0:1787829871.473046:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284098048 00000100:00100000:2.0:1787829871.473066:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284098048 00000100:00100000:3.0:1787829871.476626:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787829871.476645:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ed21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1874675284098048:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787829871.476890:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787829871.476991:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ed21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1874675284098048:12345-0@lo:400:kworker.0 Request processed in 349us (7000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829871.477000:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787829871.477134:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1874675284098048:0@lo:400:kworker.0 00000001:00100000:2.0:1787829871.541354:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 902200d4-578b-4474-a651-ffe6603128fa 00000020:00000080:2.0:1787829871.541365:0:6674:0:(genops.c:885:class_export_put()) final put ffff9e9b75da4000/902200d4-578b-4474-a651-ffe6603128fa 00000020:00000080:3.0:1787829871.542277:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b75da4000/902200d4-578b-4474-a651-ffe6603128fa for lustre-OST0000 00000020:00000080:3.0:1787829871.553007:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b75da2000 for lustre-OST0000 00000100:00100000:3.0:1787829871.972372:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284098304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787829871.972543:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829871.973911:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284098304 00000100:00100000:0.0:1787829871.973928:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284098304 00000100:00100000:0.0:1787829871.974009:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787829871.974037:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284098304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787829871.974298:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787829871.974411:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284098304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 392us (1868us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829871.974422:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1787829871.974472:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b6fa4f0c0 x1874675284098304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829871.974502:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284098304:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1787829872.227092:0:10983:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787829872.298456:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829873.314511:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829873.439865:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829873.439914:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829873.439969:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829873.440010:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275676288 00000100:00100000:1.0:1787829873.440051:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275676288 00000100:00100000:0.0:1787829873.440468:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275676160 00000100:00100000:0.0:1787829873.440474:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275676160 00000100:00100000:0.0:1787829873.440522:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 88 00000100:00100000:0.0:1787829873.440534:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:2361:x1874675275676160:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787829873.440649:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:2361:x1874675275676160:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 117us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829873.440659:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 88 00000100:00080000:0.0:1787829873.440689:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787829873.441514:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 89 00000100:00100000:1.0:1787829873.441531:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:902200d4-578b-4474-a651-ffe6603128fa+5:2361:x1874675275676288:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829873.441603:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:902200d4-578b-4474-a651-ffe6603128fa+5:2361:x1874675275676288:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 77us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829873.441611:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 89 00000100:00100000:3.0:1787829873.442011:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275676032 00000100:00100000:3.0:1787829873.442098:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275676032 00000100:00100000:3.0:1787829873.442149:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 230 00000100:00100000:3.0:1787829873.442169:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2361:x1874675275676032:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829873.442223:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2361:x1874675275676032:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 67us (2374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829873.442231:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 230 00010000:00010000:0.0:1787829874.344521:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829875.364337:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787829875.673441:0:11131:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef383e930 20000000:00000080:2.0:1787829875.673469:0:11131:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e9b75cd7400 uarg=0000000000000000 20000000:01000000:2.0:1787829875.673522:0:11131:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787829875.673531:0:11131:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787829875.673548:0:11131:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787829875.675451:0:11132:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1787829875.676106:0:11131:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787829875.691410:0:11131:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787829875.691455:0:11131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e9b74e3e600/0xc03b4d103c0d78e9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829875.691482:0:11131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b4164e600/0xc03b4d103c0d788e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c86ba expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829875.691494:0:11131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b596ca600/0xc03b4d103c0d789c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7895 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829875.691501:0:11131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b4164e400/0xc03b4d103c0d78aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d78a3 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829875.691508:0:11131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b4164ec00/0xc03b4d103c0d78b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d78b1 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829875.691516:0:11131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b48cda200/0xc03b4d103c0d78cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c86f2 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829875.691526:0:11131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e9b74e3e600/0xc03b4d103c0d78e9 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829875.692392:0:11131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b48cda200/0xc03b4d103c0d78cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c86f2 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829875.692437:0:11131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9b48cda200/0xc03b4d103c0d78cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c86f2 expref: 12 pid: 5799 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829875.692457:0:11131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11131:1874675284098432:192.168.201.51@tcp:104: 00010000:00010000:2.0:1787829875.692612:0:11131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b4164ec00/0xc03b4d103c0d78b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d78b1 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829875.692621:0:11131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e9b4164ec00/0xc03b4d103c0d78b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d78b1 expref: 18 pid: 5800 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829875.693802:0:11131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11131:1874675284098560:0@lo:104: 00000100:00100000:2.0:1787829875.693877:0:11131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787829875.693961:0:11131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b4164e400/0xc03b4d103c0d78aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d78a3 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829875.693974:0:11131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e9b4164e400/0xc03b4d103c0d78aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d78a3 expref: 18 pid: 5799 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829875.693983:0:11131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd3c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11131:1874675284098688:0@lo:104: 00000100:00100000:2.0:1787829875.694010:0:11131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787829875.694056:0:11131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b596ca600/0xc03b4d103c0d789c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d7895 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829875.694064:0:11131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e9b596ca600/0xc03b4d103c0d789c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d7895 expref: 18 pid: 5798 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829875.694073:0:11131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd03c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11131:1874675284098816:0@lo:104: 00000100:00100000:1.0:1787829875.694820:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284098560 00000100:00100000:1.0:1787829875.694831:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284098560 00000100:00100000:1.0:1787829875.694885:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284098688 00000100:00100000:1.0:1787829875.694888:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284098688 00000100:00100000:1.0:1787829875.694905:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787829875.694915:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+4:11131:x1874675284098560:12345-0@lo:104: 00010000:00010000:1.0:1787829875.694932:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fc00/0xc03b4d103c0d78b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d78b8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829875.695044:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787829875.695068:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+4:11131:x1874675284098560:12345-0@lo:104: Request processed in 154us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829875.695075:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787829875.695273:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787829875.695286:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:11131:x1874675284098688:12345-0@lo:104: 00010000:00010000:0.0:1787829875.695296:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d78a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d78aa expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829875.695353:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787829875.695358:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:11131:x1874675284098688:12345-0@lo:104: Request processed in 78us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829875.695364:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1787829875.695509:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787829875.695518:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fc00/0xc03b4d103c0d78b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d78b8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829875.695527:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164fc00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:3.0:1787829875.695532:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fc00/0xc03b4d103c0d78b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d78b8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829875.695554:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fc00/0xc03b4d103c0d78b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d78b8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787829875.695561:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fc00/0xc03b4d103c0d78b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d78b8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787829875.695568:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787829875.695622:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fc00/0xc03b4d103c0d78b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d78b8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829875.696043:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787829875.696303:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787829875.696342:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fc00/0xc03b4d103c0d78b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d78b8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829875.696350:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fc00/0xc03b4d103c0d78b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d78b8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829875.696370:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829875.696379:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829875.696381:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787829875.696390:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787829875.696409:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fec6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284098944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787829875.696478:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829875.696548:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284098944 00000100:00100000:3.0:1787829875.696556:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284098944 00010000:00010000:3.0:1787829875.696590:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b4164ec00/0xc03b4d103c0d78b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d78b1 expref: 19 pid: 5800 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829875.696617:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787829875.696637:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b51a05850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3279:x1874675284098944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787829875.696653:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829875.696658:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b4164ec00/0xc03b4d103c0d78b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d78b1 expref: 19 pid: 5800 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829875.696667:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b4164ec00/0xc03b4d103c0d78b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d78b1 expref: 19 pid: 5800 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829875.696691:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787829875.696726:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b51a05850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3279:x1874675284098944:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829875.696732:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787829875.696812:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fec6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284098944:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787829875.696992:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829875.696998:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d78a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d78aa expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829875.697006:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40030a00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:3.0:1787829875.697047:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d78a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d78aa expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829875.697056:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d78a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d78aa expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787829875.697064:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d78a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d78aa expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787829875.697070:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1787829875.697329:0:11131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829875.697364:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284098816 00000100:00100000:2.0:1787829875.697369:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284098816 00000100:00100000:2.0:1787829875.697402:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787829875.697410:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:11131:x1874675284098816:12345-0@lo:104: 00010000:00010000:2.0:1787829875.697421:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda800/0xc03b4d103c0d7895 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d789c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829875.697461:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787829875.697466:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:11131:x1874675284098816:12345-0@lo:104: Request processed in 58us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829875.697472:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1787829875.697513:0:11131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b4164e600/0xc03b4d103c0d788e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c86ba expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829875.697526:0:11131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9b4164e600/0xc03b4d103c0d788e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c86ba expref: 12 pid: 5799 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829875.697552:0:11131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11131:1874675284099072:192.168.201.51@tcp:104: 00000100:00100000:2.0:1787829875.697617:0:11131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4fa6ccc0 going to sleep for 11 seconds 00010000:00010000:2.0:1787829875.697638:0:11131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b4164ec00/0xc03b4d103c0d78b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d78b1 expref: 18 pid: 5800 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829875.697651:0:11131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11131:1874675284098560:0@lo:104: 00000100:00100000:2.0:1787829875.697662:0:11131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd3c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11131:1874675284098688:0@lo:104: 00000100:00100000:2.0:1787829875.697669:0:11131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd03c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11131:1874675284098816:0@lo:104: 00010000:00010000:2.0:1787829875.697704:0:11133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787829875.697709:0:11133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda800/0xc03b4d103c0d7895 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d789c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829875.697726:0:11133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b48cda800 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:2.0:1787829875.697729:0:11133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda800/0xc03b4d103c0d7895 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d789c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829875.697736:0:11133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda800/0xc03b4d103c0d7895 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d789c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787829875.697743:0:11133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda800/0xc03b4d103c0d7895 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d789c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787829875.697749:0:11133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787829875.697768:0:11133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda800/0xc03b4d103c0d7895 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d789c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829875.697773:0:11133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787829875.697788:0:11133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda800/0xc03b4d103c0d7895 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d789c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829875.697795:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda800/0xc03b4d103c0d7895 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d789c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829875.697815:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829875.697817:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829875.697819:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829875.697831:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787829875.697844:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284099200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787829875.697871:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829875.697905:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284099200 00000100:00100000:2.0:1787829875.697909:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284099200 00010000:00010000:2.0:1787829875.697931:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b596ca600/0xc03b4d103c0d789c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d7895 expref: 18 pid: 5798 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829875.697954:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787829875.697961:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:3279:x1874675284099200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787829875.697971:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829875.697975:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b596ca600/0xc03b4d103c0d789c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d7895 expref: 18 pid: 5798 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829875.697985:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b596ca600/0xc03b4d103c0d789c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d7895 expref: 18 pid: 5798 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829875.697998:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b596ca600/0xc03b4d103c0d789c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d7895 expref: 18 pid: 5798 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829875.698011:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787829875.698073:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:3279:x1874675284099200:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829875.698080:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1787829875.698649:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d78a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d78aa expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829875.698658:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787829875.698680:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d78a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d78aa expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829875.698687:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d78a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d78aa expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829875.698707:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829875.698709:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829875.698711:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829875.703397:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787829875.703442:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fec6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3281:1874675284099328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787829875.703553:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829875.703712:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284099200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787829875.703925:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284099328 00000100:00100000:1.0:1787829875.703935:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284099328 00010000:00010000:1.0:1787829875.703989:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b4164e400/0xc03b4d103c0d78aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d78a3 expref: 17 pid: 5799 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829875.704058:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787829875.704070:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:3281:x1874675284099328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787829875.704103:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829875.704109:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b4164e400/0xc03b4d103c0d78aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d78a3 expref: 17 pid: 5799 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829875.704122:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b4164e400/0xc03b4d103c0d78aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d78a3 expref: 17 pid: 5799 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829875.704146:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b4164e400/0xc03b4d103c0d78aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d78a3 expref: 17 pid: 5799 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829875.704165:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829875.704228:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:3281:x1874675284099328:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829875.704237:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787829875.704270:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fec6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3281:1874675284099328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787829875.707904:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829875.708068:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829875.709581:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275676416 00000100:00100000:0.0:1787829875.709599:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275676416 00010000:00010000:0.0:1787829875.709662:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b48cda200/0xc03b4d103c0d78cd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c86f2 expref: 13 pid: 5799 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829875.709711:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275676544 00000100:00100000:0.0:1787829875.709714:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275676544 00010000:00010000:0.0:1787829875.709728:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b4164e600/0xc03b4d103c0d788e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c86ba expref: 14 pid: 5799 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829875.709744:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 28 00000100:00100000:0.0:1787829875.709752:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aaccd34-1037-4ac9-aa31-e92ce8889520+14:2363:x1874675275676416:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787829875.709774:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829875.709780:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b48cda200/0xc03b4d103c0d78cd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c86f2 expref: 14 pid: 5799 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829875.709794:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b48cda200/0xc03b4d103c0d78cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c86f2 expref: 14 pid: 5799 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829875.709843:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829875.709922:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aaccd34-1037-4ac9-aa31-e92ce8889520+14:2363:x1874675275676416:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 171us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829875.709930:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 28 00000100:00100000:0.0:1787829875.709955:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 29 00000100:00100000:0.0:1787829875.709961:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2362:x1874675275676544:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787829875.709968:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829875.709971:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b4164e600/0xc03b4d103c0d788e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c86ba expref: 13 pid: 5799 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829875.709980:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b4164e600/0xc03b4d103c0d788e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c86ba expref: 13 pid: 5799 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829875.709992:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e9b74e3e600/0xc03b4d103c0d78e9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829875.710001:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b74e3e600/0xc03b4d103c0d78e9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829875.710041:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b74e3e600/0xc03b4d103c0d78e9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829875.710048:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b74e3e600/0xc03b4d103c0d78e9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829875.710054:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e9b74e3e600/0xc03b4d103c0d78e9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829875.710060:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e9b74e3e600/0xc03b4d103c0d78e9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829875.710073:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3e600 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787829875.710189:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e9b74e3e600/0xc03b4d103c0d78e9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829875.710200:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e9b74e3e600/0xc03b4d103c0d78e9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829875.710276:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e9b74e3e600/0xc03b4d103c0d78e9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829875.710290:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829875.710313:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2362:x1874675275676544:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 351us (2245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829875.710320:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 29 00010000:00010000:0.0:1787829875.710571:0:11131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b48cda200/0xc03b4d103c0d78cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c86f2 expref: 12 pid: 5799 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829875.710588:0:11131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11131:1874675284098432:192.168.201.51@tcp:104: 00010000:00010000:0.0:1787829875.710601:0:11131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b4164e600/0xc03b4d103c0d788e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c86ba expref: 11 pid: 5799 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829875.710611:0:11131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11131:1874675284099072:192.168.201.51@tcp:104: 00010000:00010000:0.0:1787829875.710660:0:11131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e9b74e3e600/0xc03b4d103c0d78e9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829875.710670:0:11131:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e9b74e3e600/0xc03b4d103c0d78e9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829875.710688:0:11131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e9b74e3e600/0xc03b4d103c0d78e9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829875.710695:0:11131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b74e3e600/0xc03b4d103c0d78e9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829876.387671:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829876.580439:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787829876.580472:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fef5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284099456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787829876.580581:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829876.580683:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284099456 00000100:00100000:0.0:1787829876.580693:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284099456 00000100:00100000:0.0:1787829876.580763:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787829876.580775:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284099456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787829876.580822:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787829876.580878:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284099456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829876.580886:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1787829876.580927:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787829876.580970:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7fef5a40 x1874675284099456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829876.580993:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fef5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284099456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787829876.581408:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284099584:0@lo:400:kworker.0 00000100:00100000:1.0:1787829876.581466:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829876.581514:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284100096:0@lo:400:kworker.0 00000100:00100000:0.0:1787829876.581539:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284099840:0@lo:400:kworker.0 00000100:00100000:1.0:1787829876.581565:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829876.581584:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829876.581594:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787829876.581604:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284099712:0@lo:400:kworker.0 00000100:00100000:0.0:1787829876.581616:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787829876.581625:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1874675284099968:0@lo:400:kworker.0 00000100:00100000:1.0:1787829876.581635:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829876.581659:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829876.581681:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284099584 00000100:00100000:1.0:1787829876.581688:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284099584 00000100:00100000:0.0:1787829876.581710:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284099840 00000100:00100000:0.0:1787829876.581716:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284099840 00000100:00100000:1.0:1787829876.581743:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787829876.581754:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:3278:x1874675284099584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829876.581758:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284099712 00000100:00100000:0.0:1787829876.581763:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284099712 00000100:00100000:0.0:1787829876.581784:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284099968 00000100:00100000:0.0:1787829876.581788:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284099968 00000100:00100000:1.0:1787829876.581807:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:3278:x1874675284099584:12345-0@lo:400:kworker.0 Request processed in 54us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829876.581812:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787829876.581821:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787829876.581825:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284099840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829876.581861:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284100096 00000100:00100000:1.0:1787829876.581867:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284100096 00000100:00100000:0.0:1787829876.581874:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284099840:12345-0@lo:400:kworker.0 Request processed in 52us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829876.581883:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787829876.581905:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787829876.581915:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284100096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829876.581921:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787829876.581931:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284099712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829876.581959:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284100096:12345-0@lo:400:kworker.0 Request processed in 46us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829876.581967:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787829876.581973:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284099712:12345-0@lo:400:kworker.0 Request processed in 44us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829876.581981:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787829876.581993:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787829876.582003:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874675284099968:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787829876.582053:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787829876.582059:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787829876.582074:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874675284099968:12345-0@lo:400:kworker.0 Request processed in 73us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829876.582081:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787829876.582132:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284099712:0@lo:400:kworker.0 00000100:00100000:1.0:1787829876.582143:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284099584:0@lo:400:kworker.0 00010000:00080000:1.0:1787829876.582169:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f4d4f00 x1874675284100096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829876.582179:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284100096:0@lo:400:kworker.0 00000100:00100000:0.0:1787829876.583540:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1874675284099968:0@lo:400:kworker.0 00000100:00100000:0.0:1787829876.583566:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284099840:0@lo:400:kworker.0 00000100:00100000:1.0:1787829877.093356:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284100224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787829877.093457:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829877.093754:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284100224 00000100:00100000:0.0:1787829877.093765:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284100224 00000100:00100000:0.0:1787829877.098079:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787829877.098104:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284100224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787829877.098160:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787829877.098613:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284100224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 518us (5153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829877.098639:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1787829877.099397:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b75cd03c0 x1874675284100224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829877.099426:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284100224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787829877.151304:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829877.151393:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275676672 00000100:00100000:3.0:1787829877.151406:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275676672 00000100:00100000:3.0:1787829877.151480:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 232 00000100:00100000:3.0:1787829877.151492:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+11:5602:x1874675275676672:12345-192.168.201.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787829877.151523:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829877.151559:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b596cb800/0xc03b4d103c0d78f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x53172783628c871c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829877.151597:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b596cb800/0xc03b4d103c0d78f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c871c expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829877.151610:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b596cb800/0xc03b4d103c0d78f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c871c expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829877.151620:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b596cb800, rc 0) 00000100:00100000:3.0:1787829877.151691:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+12:5602:x1874675275676672:12345-192.168.201.51@tcp:101:ll_cfg_requeue.0 Request processed in 201us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829877.151699:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 232 00000100:00100000:0.0:1787829877.162977:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829877.163694:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275676800 00000100:00100000:1.0:1787829877.163709:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275676800 00000100:00100000:1.0:1787829877.166463:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 233 00000100:00100000:1.0:1787829877.166504:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+12:5602:x1874675275676800:12345-192.168.201.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787829877.166914:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+12:5602:x1874675275676800:12345-192.168.201.51@tcp:501:ll_cfg_requeue.0 Request processed in 422us (3949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829877.166924:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 233 00000100:00100000:1.0:1787829877.179177:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829877.179292:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275676928 00000100:00100000:3.0:1787829877.179305:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275676928 00000100:00100000:3.0:1787829877.179366:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 234 00000100:00100000:3.0:1787829877.179379:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+12:5602:x1874675275676928:12345-192.168.201.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787829877.179665:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+12:5602:x1874675275676928:12345-192.168.201.51@tcp:503:ll_cfg_requeue.0 Request processed in 288us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829877.179675:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 234 00000100:00100000:3.0:1787829877.189360:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829877.193145:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275677056 00000100:00100000:1.0:1787829877.193163:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275677056 00000100:00100000:1.0:1787829877.193246:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 235 00000100:00100000:1.0:1787829877.193261:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+12:5602:x1874675275677056:12345-192.168.201.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787829877.193286:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829877.193311:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b48cdb400/0xc03b4d103c0d78f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x53172783628c8723 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829877.193374:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b48cdb400/0xc03b4d103c0d78f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8723 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829877.193387:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b48cdb400/0xc03b4d103c0d78f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8723 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829877.193397:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b48cdb400, rc 0) 00000100:00100000:1.0:1787829877.193486:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:5602:x1874675275677056:12345-192.168.201.51@tcp:101:ll_cfg_requeue.0 Request processed in 231us (4137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829877.193493:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 235 00000100:00100000:3.0:1787829877.198814:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829877.199279:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275677184 00000100:00100000:2.0:1787829877.199296:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275677184 00000100:00100000:2.0:1787829877.199368:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 236 00000100:00100000:2.0:1787829877.199379:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:5602:x1874675275677184:12345-192.168.201.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787829877.199760:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:5602:x1874675275677184:12345-192.168.201.51@tcp:501:ll_cfg_requeue.0 Request processed in 382us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829877.199770:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 236 00000100:00100000:3.0:1787829877.209676:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829877.209744:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275677312 00000100:00100000:1.0:1787829877.209761:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275677312 00000100:00100000:1.0:1787829877.209840:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 237 00000100:00100000:1.0:1787829877.209853:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:5602:x1874675275677312:12345-192.168.201.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787829877.210209:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:5602:x1874675275677312:12345-192.168.201.51@tcp:503:ll_cfg_requeue.0 Request processed in 357us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829877.210218:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 237 00010000:00010000:3.0:1787829877.410774:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787829877.410903:0:5802:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787829877.410909:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9b7f524800 from 7 10000000:01000000:1.0:1787829877.410916:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787829877.410974:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdba00/0xc03b4d103c0d78fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829877.410988:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdba00/0xc03b4d103c0d78fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829877.411003:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdba00/0xc03b4d103c0d78fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829877.411078:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4d61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284100352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787829877.411176:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829877.411240:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4fa23240 going to sleep for 11 seconds 00000100:00100000:2.0:1787829877.411771:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284100352 00000100:00100000:2.0:1787829877.411783:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284100352 00000100:00100000:2.0:1787829877.411866:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787829877.411878:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:5802:x1874675284100352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787829877.411896:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829877.411913:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b74e3e400/0xc03b4d103c0d7905 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d78fe expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829877.411944:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b74e3e400/0xc03b4d103c0d7905 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d78fe expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829877.411955:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b74e3e400/0xc03b4d103c0d7905 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d78fe expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829877.411965:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3e400, rc 0) 00000100:00100000:2.0:1787829877.412058:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284100352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829877.412065:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787829877.412191:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4d61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284100352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787829877.412211:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdba00/0xc03b4d103c0d78fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7905 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829877.412235:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdba00/0xc03b4d103c0d78fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d7905 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829877.412318:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fec52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284100480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787829877.412353:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829877.412393:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47ae0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787829877.412493:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284100480 00000100:00100000:1.0:1787829877.412499:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284100480 00000100:00100000:1.0:1787829877.412536:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787829877.412544:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284100480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787829877.412845:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284100480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 300us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829877.412854:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787829877.413005:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fec52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284100480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787829877.413092:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fec52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284100608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787829877.413140:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829877.413157:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47ae0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787829877.413171:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284100608 00000100:00100000:3.0:1787829877.413175:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284100608 00000100:00100000:3.0:1787829877.413201:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787829877.413208:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284100608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787829877.413371:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284100608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829877.413379:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787829877.413416:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fec52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284100608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787829877.426775:0:11174:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787829877.427099:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787829877.427122:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787829877.427136:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdba00/0xc03b4d103c0d78fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7905 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829877.427150:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdba00/0xc03b4d103c0d78fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7905 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787829877.427162:0:5802:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787829877.427165:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9b53977800 from 7 10000000:01000000:1.0:1787829877.427168:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787829877.427219:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda400/0xc03b4d103c0d790c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829877.427228:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda400/0xc03b4d103c0d790c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829877.427241:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda400/0xc03b4d103c0d790c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829877.427294:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4d61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284100736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787829877.427382:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829877.427436:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4fa23e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787829877.430712:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284100736 00000100:00100000:2.0:1787829877.430729:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284100736 00000100:00100000:2.0:1787829877.430798:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787829877.430810:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284100736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787829877.430829:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829877.430852:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b74e3ee00/0xc03b4d103c0d7913 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d790c expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829877.430888:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b74e3ee00/0xc03b4d103c0d7913 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d790c expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829877.430901:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b74e3ee00/0xc03b4d103c0d7913 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d790c expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829877.430920:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3ee00, rc 0) 00000100:00100000:2.0:1787829877.431046:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284100736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 238us (3664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829877.431055:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787829877.431128:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4d61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284100736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787829877.431152:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda400/0xc03b4d103c0d790c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7913 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829877.431162:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda400/0xc03b4d103c0d790c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d7913 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829877.431248:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284100864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787829877.431285:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829877.431318:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4fa6cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787829877.431333:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284100864 00000100:00100000:2.0:1787829877.431337:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284100864 00000100:00100000:2.0:1787829877.431365:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787829877.431372:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284100864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787829877.431695:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284100864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 322us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829877.431702:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787829877.431737:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284100864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787829877.431783:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284100992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787829877.431825:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829877.431846:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4fa6cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787829877.431861:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284100992 00000100:00100000:2.0:1787829877.431864:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284100992 00000100:00100000:2.0:1787829877.431887:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787829877.431894:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284100992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787829877.432078:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284100992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 184us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829877.432085:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787829877.432124:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284100992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787829877.435127:0:11178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787829877.435370:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787829877.435397:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787829877.435411:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda400/0xc03b4d103c0d790c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7913 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829877.435425:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda400/0xc03b4d103c0d790c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7913 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787829877.435454:0:5802:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787829877.435457:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9b51a3b000 from 7 10000000:01000000:3.0:1787829877.435461:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787829877.435602:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb200/0xc03b4d103c0d791a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829877.435611:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb200/0xc03b4d103c0d791a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829877.435625:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb200/0xc03b4d103c0d791a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829877.435656:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fec52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284101120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787829877.435744:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829877.435784:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47ae0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787829877.436340:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284101120 00000100:00100000:2.0:1787829877.436350:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284101120 00000100:00100000:2.0:1787829877.436413:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787829877.436425:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284101120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787829877.436441:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829877.436459:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b74e3f800/0xc03b4d103c0d7921 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d791a expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829877.437923:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b74e3f800/0xc03b4d103c0d7921 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d791a expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829877.437945:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b74e3f800/0xc03b4d103c0d7921 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d791a expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829877.437958:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3f800, rc 0) 00000100:00100000:2.0:1787829877.438076:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:5802:x1874675284101120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1653us (2331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829877.438086:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787829877.438327:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fec52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284101120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787829877.438350:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb200/0xc03b4d103c0d791a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7921 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829877.438361:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb200/0xc03b4d103c0d791a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d7921 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829877.438450:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fec52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284101248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787829877.438556:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829877.438599:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47ae0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787829877.438748:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284101248 00000100:00100000:2.0:1787829877.438755:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284101248 00000100:00100000:2.0:1787829877.438808:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787829877.438818:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:5802:x1874675284101248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787829877.440174:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:5802:x1874675284101248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1346us (1606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829877.440186:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787829877.447125:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fec52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284101248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787829877.447212:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fec52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284101376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787829877.447318:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829877.447369:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47ae0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787829877.447875:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284101376 00000100:00100000:2.0:1787829877.447885:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284101376 00000100:00100000:2.0:1787829877.447953:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787829877.447965:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:5802:x1874675284101376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787829877.448270:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:5802:x1874675284101376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 304us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829877.448278:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787829877.448418:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fec52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284101376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787829877.452208:0:11182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787829877.452465:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787829877.452492:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787829877.452505:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb200/0xc03b4d103c0d791a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7921 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829877.452526:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb200/0xc03b4d103c0d791a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7921 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829878.434308:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829878.569900:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829878.570076:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275677440 00000100:00100000:2.0:1787829878.570090:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275677440 00000100:00100000:2.0:1787829878.570164:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 247 00000100:00100000:2.0:1787829878.570178:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2360:x1874675275677440:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787829878.570181:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829878.570223:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829878.570251:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275677696 00000100:00100000:0.0:1787829878.570256:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275677696 00000100:00100000:2.0:1787829878.570287:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2360:x1874675275677440:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 111us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829878.570303:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275677568 00000100:00100000:0.0:1787829878.570308:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275677568 00000100:00100000:2.0:1787829878.570314:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 247 00000100:00100000:0.0:1787829878.570339:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 93 00000100:00100000:0.0:1787829878.570350:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:902200d4-578b-4474-a651-ffe6603128fa+5:2360:x1874675275677696:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829878.570521:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 94 00000100:00100000:1.0:1787829878.570532:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:2360:x1874675275677568:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829878.570624:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:2360:x1874675275677568:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 94us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829878.570631:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 94 00000100:00080000:1.0:1787829878.571345:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787829878.571631:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:902200d4-578b-4474-a651-ffe6603128fa+5:2360:x1874675275677696:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 42us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829878.571648:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 93 00010000:00010000:3.0:1787829879.468625:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787829880.351113:0:11330:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg151-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787829880.483267:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829881.506406:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829881.698187:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fef6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284101504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787829881.698268:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829881.698470:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284101504 00000100:00100000:2.0:1787829881.698480:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284101504 00000100:00100000:2.0:1787829881.698547:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787829881.698557:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284101504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787829881.698602:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787829881.698654:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284101504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829881.698661:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1787829881.698686:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787829881.698713:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284101760:0@lo:400:kworker.0 00000100:00100000:2.0:1787829881.698744:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829881.698745:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1874675284101888:0@lo:400:kworker.0 00000100:00100000:2.0:1787829881.698775:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284101760 00000100:00100000:1.0:1787829881.698775:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829881.698778:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284101760 00000100:00100000:2.0:1787829881.698806:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284101888 00000100:00100000:1.0:1787829881.698819:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787829881.698828:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284101760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829881.698867:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284101760:12345-0@lo:400:kworker.0 Request processed in 41us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829881.698869:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3281:1874675284101632:0@lo:400:kworker.0 00000100:00100000:1.0:1787829881.698874:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787829881.698950:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284101888 00000100:00100000:2.0:1787829881.698981:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787829881.698988:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1874675284101888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829881.699044:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1874675284101888:12345-0@lo:400:kworker.0 Request processed in 57us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829881.699051:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787829881.699067:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1874675284102016:0@lo:400:kworker.0 00000100:00100000:2.0:1787829881.699088:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1874675284101888:0@lo:400:kworker.0 00000100:00100000:1.0:1787829881.699107:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787829881.699109:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787829881.699124:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284101760:0@lo:400:kworker.0 00010000:00080000:1.0:1787829881.699134:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7fef6580 x1874675284101504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829881.699150:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fef6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284101504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787829881.699178:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284102016 00000100:00100000:1.0:1787829881.699182:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284102016 00000100:00100000:1.0:1787829881.699208:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787829881.699213:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874675284102016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829881.699247:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874675284102016:12345-0@lo:400:kworker.0 Request processed in 33us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829881.699253:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787829881.699332:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1874675284102016:0@lo:400:kworker.0 00000100:00100000:0.0:1787829881.699602:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829881.699632:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284102144:0@lo:400:kworker.0 00000100:00100000:0.0:1787829881.699659:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829881.699690:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284101632 00000100:00100000:0.0:1787829881.699693:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284101632 00000100:00100000:1.0:1787829881.699705:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284102144 00000100:00100000:1.0:1787829881.699709:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284102144 00000100:00100000:0.0:1787829881.699723:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787829881.699729:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3281:x1874675284101632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829881.699737:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787829881.699743:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284102144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829881.699773:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284102144:12345-0@lo:400:kworker.0 Request processed in 30us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829881.699773:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3281:x1874675284101632:12345-0@lo:400:kworker.0 Request processed in 43us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829881.699780:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787829881.699781:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787829881.699813:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3281:1874675284101632:0@lo:400:kworker.0 00010000:00080000:0.0:1787829881.699823:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f4c52c0 x1874675284102144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829881.699831:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284102144:0@lo:400:kworker.0 00000100:00080000:2.0:1787829881.700229:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787829881.700240:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787829882.210613:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284102272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787829882.210710:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829882.210930:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284102272 00000100:00100000:1.0:1787829882.210939:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284102272 00000100:00100000:1.0:1787829882.210997:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787829882.211007:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284102272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787829882.211083:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787829882.211136:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284102272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829882.211144:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1787829882.211193:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f4c4f00 x1874675284102272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829882.211228:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284102272:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787829882.531145:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829883.556142:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787829883.684921:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829883.685246:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275677824 00000100:00100000:1.0:1787829883.685259:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275677824 00000100:00100000:1.0:1787829883.685490:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 249 00000100:00100000:1.0:1787829883.685504:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2362:x1874675275677824:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829883.685627:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2362:x1874675275677824:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 126us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829883.685637:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 249 00000100:00100000:2.0:1787829883.689713:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829883.691192:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275677952 00000100:00100000:3.0:1787829883.691212:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275677952 00000100:00080000:2.0:1787829883.691421:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787829883.691546:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 98 00000100:00100000:1.0:1787829883.691566:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+6:2362:x1874675275677952:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829883.691688:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+6:2362:x1874675275677952:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 130us (2022us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829883.691697:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 98 00000100:00100000:3.0:1787829883.707765:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829883.707862:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275678080 00000100:00100000:2.0:1787829883.707874:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275678080 00000100:00100000:2.0:1787829883.708741:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 99 00000100:00100000:2.0:1787829883.708762:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:902200d4-578b-4474-a651-ffe6603128fa+5:2362:x1874675275678080:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829883.708872:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:902200d4-578b-4474-a651-ffe6603128fa+5:2362:x1874675275678080:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 119us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829883.708881:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 99 00000100:00080000:3.0:1787829883.708965:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1787829884.235331:0:11430:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 07:24:43 (1787829883) === 00000100:00100000:2.0:1787829884.486683:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829884.486769:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829884.486827:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275678208 00000100:00100000:2.0:1787829884.486838:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275678208 00000100:00100000:1.0:1787829884.486861:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275678336 00000100:00100000:1.0:1787829884.486868:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275678336 00000100:00100000:2.0:1787829884.486913:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 14 00000100:00100000:1.0:1787829884.486929:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 0 00000100:00100000:2.0:1787829884.486931:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+7:2363:x1874675275678208:12345-192.168.201.51@tcp:41:mkdir.0 00000100:00100000:1.0:1787829884.486944:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b6abf229-545c-43fd-8dee-d9adf582be48+7:9703:x1874675275678336:12345-192.168.201.51@tcp:700:mkdir.0 00000004:00000024:2.0:1787829884.486977:0:5806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787829884.487051:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b6abf229-545c-43fd-8dee-d9adf582be48+7:9703:x1874675275678336:12345-192.168.201.51@tcp:700:mkdir.0 Request processed in 112us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829884.487059:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+7:2363:x1874675275678208:12345-192.168.201.51@tcp:41:mkdir.0 Request processed in 133us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829884.487064:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 0 00000100:00100000:2.0:1787829884.487073:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 14 00000100:00100000:3.0:1787829884.499608:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829884.499721:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275678592 00000100:00100000:1.0:1787829884.499737:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275678592 00000100:00100000:1.0:1787829884.499809:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 15 00000100:00100000:1.0:1787829884.499833:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+6:9703:x1874675275678592:12345-192.168.201.51@tcp:36:mkdir.0 00010000:00010000:1.0:1787829884.499896:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829884.499972:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596ca000/0xc03b4d103c0d7809 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c86a5 expref: 6 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.499995:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b478cc600) 00010000:00010000:1.0:1787829884.500052:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787829884.500415:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cda200/0xc03b4d103c0d7928 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.500432:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cda200/0xc03b4d103c0d7928 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.500444:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cda200/0xc03b4d103c0d7928 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.500471:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cdaa00/0xc03b4d103c0d792f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.500479:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cdaa00/0xc03b4d103c0d792f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.500486:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cdaa00/0xc03b4d103c0d792f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787829884.503649:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787829884.503667:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cda200/0xc03b4d103c0d7928 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.503677:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cda200/0xc03b4d103c0d7928 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.503694:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cda200/0xc03b4d103c0d7928 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.503700:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b48cda200 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829884.503704:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cda200/0xc03b4d103c0d7928 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.503712:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cda200/0xc03b4d103c0d7928 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.503728:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b507a7700) 00010000:00010000:1.0:1787829884.503731:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829884.503735:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cda200/0xc03b4d103c0d7928 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.503741:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cda200/0xc03b4d103c0d7928 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787829884.503759:0:5804:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000199dc51d reply state 000000001ef68b04 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cdaa00/0xc03b4d103c0d792f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829884.503768:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787829884.503862:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+7:9703:x1874675275678592:12345-192.168.201.51@tcp:36:mkdir.0 Request processed in 4026us (4266us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787829884.503870:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 15 00010000:00010000:1.0:1787829884.507130:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cdaa00/0xc03b4d103c0d792f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.507147:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cdaa00/0xc03b4d103c0d792f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.507173:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cdaa00/0xc03b4d103c0d792f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.507179:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b48cdaa00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829884.507183:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cdaa00/0xc03b4d103c0d792f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.507191:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cdaa00/0xc03b4d103c0d792f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.507207:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e9b507a7800) 00010000:00010000:1.0:1787829884.507210:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829884.507215:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cdaa00/0xc03b4d103c0d792f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.507221:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cdaa00/0xc03b4d103c0d792f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829884.538007:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829884.538523:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275678720 00000100:00100000:2.0:1787829884.538533:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275678720 00000100:00100000:2.0:1787829884.538597:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 16 00000100:00100000:2.0:1787829884.538607:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+6:9705:x1874675275678720:12345-192.168.201.51@tcp:101:chmod.0 00010000:00010000:2.0:1787829884.538628:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829884.538654:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7936 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c872a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.538730:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d793d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.538744:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d793d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.538756:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d793d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787829884.538815:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787829884.538819:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787829884.538859:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d793d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.538883:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7936 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c872a expref: 8 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.538900:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d793d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c872a expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.538909:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b45193900) 00010000:00010000:2.0:1787829884.538912:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787829884.538915:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3f400, rc 0) 00000100:00100000:2.0:1787829884.538986:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+7:9705:x1874675275678720:12345-192.168.201.51@tcp:101:chmod.0 Request processed in 379us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829884.538993:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 16 00000100:00100000:3.0:1787829884.557124:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829884.557252:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275678976 00000100:00100000:2.0:1787829884.557262:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275678976 00000100:00100000:2.0:1787829884.557343:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 17 00000100:00100000:2.0:1787829884.557353:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+7:9705:x1874675275678976:12345-192.168.201.51@tcp:36:chmod.0 00010000:00010000:2.0:1787829884.557435:0:7257:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829884.557468:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d793d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c872a expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.557488:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b45193900) 00010000:00010000:2.0:1787829884.557500:0:7257:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787829884.557527:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7944 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.557542:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7944 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.557554:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7944 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787829884.557899:0:7257:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ea6ae43 reply state 00000000a0c0a88c transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7944 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829884.557910:0:7257:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787829884.557925:0:7257:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787829884.558078:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+8:9705:x1874675275678976:12345-192.168.201.51@tcp:36:chmod.0 Request processed in 664us (901us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787829884.558087:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 17 00010000:00010000:3.0:1787829884.566278:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7944 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.566297:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7944 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.566305:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7944 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.566311:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3e800 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829884.566315:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7944 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.566324:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7944 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.566341:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b45193100) 00010000:00010000:3.0:1787829884.566358:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787829884.566364:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7944 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.566370:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7944 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.578476:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829884.578751:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829884.578900:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275679104 00000100:00100000:1.0:1787829884.578912:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275679104 00000100:00100000:1.0:1787829884.578987:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 18 00000100:00100000:1.0:1787829884.578998:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+7:9707:x1874675275679104:12345-192.168.201.51@tcp:101:chown.0 00010000:00010000:1.0:1787829884.579053:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829884.579078:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cdaa00/0xc03b4d103c0d794b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8731 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.579149:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cda200/0xc03b4d103c0d7952 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.579182:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cda200/0xc03b4d103c0d7952 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.579194:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cda200/0xc03b4d103c0d7952 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787829884.579263:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787829884.579267:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787829884.579313:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cda200/0xc03b4d103c0d7952 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.579340:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cdaa00/0xc03b4d103c0d794b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8731 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.579359:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cda200/0xc03b4d103c0d7952 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8731 expref: 8 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.579368:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b507a7800) 00010000:00010000:1.0:1787829884.579371:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787829884.579375:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b48cda200, rc 0) 00000100:00100000:1.0:1787829884.579452:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+8:9707:x1874675275679104:12345-192.168.201.51@tcp:101:chown.0 Request processed in 457us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829884.579459:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 18 00000100:00100000:2.0:1787829884.581899:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829884.581990:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275679232 00000100:00100000:1.0:1787829884.581998:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275679232 00000100:00100000:1.0:1787829884.582088:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 19 00000100:00100000:1.0:1787829884.582099:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+8:9707:x1874675275679232:12345-192.168.201.51@tcp:101:chown.0 00010000:00010000:1.0:1787829884.582116:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829884.582146:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cda800/0xc03b4d103c0d7959 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8738 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.582211:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cdb200/0xc03b4d103c0d7960 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.582226:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cdb200/0xc03b4d103c0d7960 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.582236:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cdb200/0xc03b4d103c0d7960 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.582266:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7967 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.582275:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7967 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.582281:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7967 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.582373:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d796e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.582392:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d796e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.582400:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d796e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787829884.582439:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787829884.582443:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787829884.582466:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d796e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.582486:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cdb200/0xc03b4d103c0d7960 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.582492:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cdb200/0xc03b4d103c0d7960 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.582499:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cdb200/0xc03b4d103c0d7960 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.582505:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b48cdb200 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829884.582509:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cdb200/0xc03b4d103c0d7960 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.582516:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cdb200/0xc03b4d103c0d7960 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.582650:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b507a7800) 00010000:00010000:1.0:1787829884.582654:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829884.582660:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cdb200/0xc03b4d103c0d7960 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.582668:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cdb200/0xc03b4d103c0d7960 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.582683:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7967 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.582691:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7967 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.582770:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7967 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.582783:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feee600 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829884.582787:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7967 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.582794:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7967 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.582803:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e9b507a7700) 00010000:00010000:1.0:1787829884.582806:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829884.582809:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7967 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.582815:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7967 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.582849:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cda800/0xc03b4d103c0d7959 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8738 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.582865:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d796e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8738 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.582872:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e9b507a7300) 00010000:00010000:1.0:1787829884.582875:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787829884.582878:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feeea00, rc 0) 00000100:00100000:1.0:1787829884.582930:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+9:9707:x1874675275679232:12345-192.168.201.51@tcp:101:chown.0 Request processed in 834us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829884.582939:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 19 00000100:00100000:3.0:1787829884.586284:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829884.586488:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275679488 00000100:00100000:0.0:1787829884.586503:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275679488 00000100:00100000:0.0:1787829884.586587:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 20 00000100:00100000:0.0:1787829884.586599:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+9:9707:x1874675275679488:12345-192.168.201.51@tcp:36:chown.0 00010000:00010000:0.0:1787829884.586675:0:10044:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829884.586714:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d796e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8738 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.586738:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e9b507a7300) 00010000:00010000:0.0:1787829884.586752:0:10044:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787829884.586787:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d7975 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.586803:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d7975 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.586814:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d7975 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787829884.634330:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1787829884.636212:0:10044:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004152c076 reply state 00000000218acba4 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d7975 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829884.636245:0:10044:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787829884.636436:0:10044:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1787829884.636608:0:10044:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1787829884.636638:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+7:9707:x1874675275679488:12345-192.168.201.51@tcp:36:chown.0 Request processed in 50037us (50366us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787829884.636646:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 20 00010000:00010000:0.0:1787829884.636811:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d7975 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.636820:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d7975 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.636827:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d7975 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.636832:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40030400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829884.636837:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d7975 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.636844:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d7975 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.636860:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e9b48f25d00) 00010000:00010000:0.0:1787829884.636862:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787829884.636867:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d7975 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.636873:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d7975 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829884.656936:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829884.657106:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275679616 00000100:00100000:2.0:1787829884.657116:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275679616 00000100:00100000:2.0:1787829884.657181:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 21 00000100:00100000:2.0:1787829884.657191:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+6:9708:x1874675275679616:12345-192.168.201.51@tcp:101:touch.500 00010000:00010000:2.0:1787829884.657234:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829884.657256:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d797c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c873f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787829884.661614:0:5805:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4304us 00010000:00010000:0.0:1787829884.685717:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d7983 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.685743:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d7983 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.685774:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d7983 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.685791:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d798a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.685797:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d798a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.685876:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d798a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.690516:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d7991 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.690538:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d7991 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.690549:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d7991 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787829884.690642:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787829884.690647:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787829884.690723:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d7991 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.690734:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d7983 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.690739:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d7983 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.690750:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d7983 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.690755:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40030400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829884.690757:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d7983 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.690762:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d7983 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.690771:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b507a7800) 00010000:00010000:0.0:1787829884.690773:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787829884.690776:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d7983 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.690780:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d7983 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.690790:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d798a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.690794:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d798a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.690810:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d798a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.690815:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40030e00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829884.690818:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d798a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.690834:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d798a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.690843:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e9b48f25d00) 00010000:00010000:0.0:1787829884.690845:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787829884.690848:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d798a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.690853:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d798a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.690893:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d797c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c873f expref: 8 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.690907:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d7991 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c873f expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.690915:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e9b48f25200) 00010000:00010000:0.0:1787829884.690917:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787829884.690919:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b40031200, rc 0) 00000100:00100000:0.0:1787829884.692194:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+7:9708:x1874675275679616:12345-192.168.201.51@tcp:101:touch.500 Request processed in 34995us (35266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829884.692206:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 21 00000100:00100000:0.0:1787829884.697274:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829884.697339:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275679872 00000100:00100000:1.0:1787829884.697351:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275679872 00000100:00100000:1.0:1787829884.697425:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 22 00000100:00100000:1.0:1787829884.697437:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+7:9708:x1874675275679872:12345-192.168.201.51@tcp:101:touch.500 00010000:00010000:1.0:1787829884.697460:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829884.697482:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7998 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8746 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.697806:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d799f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.697822:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d799f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.697832:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d799f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.697882:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d79a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.697889:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d79a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.697907:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d79a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787829884.698656:0:5806:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787829884.698850:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d79ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.698859:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d79ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.698865:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d79ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.698891:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d799f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.698896:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d799f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.698900:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d799f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.698904:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feeec00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829884.698906:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d799f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.698911:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d799f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.698919:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e9b48f25200) 00010000:00010000:1.0:1787829884.698921:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829884.698930:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d799f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.698934:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d799f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787829884.698945:0:5806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e00d51c reply state 000000009f1ab52f transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d79a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829884.698951:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787829884.698976:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7998 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8746 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.698985:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d79ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8746 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.698990:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e9b507a7500) 00010000:00010000:1.0:1787829884.698992:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787829884.698994:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feee800, rc 0) 00000100:00100000:1.0:1787829884.699092:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+10:9708:x1874675275679872:12345-192.168.201.51@tcp:101:touch.500 Request processed in 1657us (1826us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787829884.699101:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 22 00010000:00010000:0.0:1787829884.700944:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d79a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.700959:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d79a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.700991:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d79a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.700996:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feef400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829884.701000:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d79a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.701007:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d79a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.701055:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x9f0a7a27 (ffff9e9b507a7700) 00010000:00010000:0.0:1787829884.701058:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787829884.701063:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d79a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.701068:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d79a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829884.707976:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829884.708073:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275680128 00000100:00100000:1.0:1787829884.708083:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275680128 00000100:00100000:1.0:1787829884.708138:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 23 00000100:00100000:1.0:1787829884.708147:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+9:9708:x1874675275680128:12345-192.168.201.51@tcp:36:touch.500 00010000:00010000:1.0:1787829884.708206:0:10044:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829884.708237:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d79ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8746 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.708275:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e9b507a7500) 00010000:00010000:1.0:1787829884.708285:0:10044:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787829884.708342:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d79bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.708356:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d79bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.708365:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d79bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787829884.708514:0:10044:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a283c39 reply state 00000000736bca41 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d79bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829884.708523:0:10044:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787829884.708615:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+10:9708:x1874675275680128:12345-192.168.201.51@tcp:36:touch.500 Request processed in 468us (664us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787829884.708622:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 23 00010000:00010000:0.0:1787829884.711260:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d79bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.711275:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d79bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.711283:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d79bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.711288:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feefc00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829884.711293:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d79bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.711313:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d79bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.711328:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e9b507a7200) 00010000:00010000:0.0:1787829884.711331:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787829884.711336:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d79bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.711342:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d79bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829884.713790:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829884.713926:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275680256 00000100:00100000:3.0:1787829884.713934:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275680256 00000100:00100000:3.0:1787829884.714001:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 24 00000100:00100000:3.0:1787829884.714011:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+9:9708:x1874675275680256:12345-192.168.201.51@tcp:101:touch.500 00010000:00010000:3.0:1787829884.714064:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829884.714088:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cbc00/0xc03b4d103c0d79c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c874d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.714150:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cbc00/0xc03b4d103c0d79c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c874d expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.714165:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cbc00/0xc03b4d103c0d79c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c874d expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.714184:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e9b478cc400) 00010000:00010000:3.0:1787829884.714187:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787829884.714191:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b596cbc00, rc 0) 00000100:00100000:3.0:1787829884.714243:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+10:9708:x1874675275680256:12345-192.168.201.51@tcp:101:touch.500 Request processed in 235us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829884.714263:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 24 00000100:00100000:3.0:1787829884.718012:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829884.718262:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275680384 00000100:00100000:2.0:1787829884.718272:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275680384 00000100:00100000:2.0:1787829884.718323:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 16 00000100:00100000:2.0:1787829884.718331:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2359:x1874675275680384:12345-192.168.201.51@tcp:8:touch.500 00010000:00080000:2.0:1787829884.718364:0:6651:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b6abf229-545c-43fd-8dee-d9adf582be48@192.168.201.51@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:2.0:1787829884.718407:0:6651:0:(genops.c:1385:class_connect()) connect: client b6abf229-545c-43fd-8dee-d9adf582be48, cookie 0xc03b4d103c0d79c9 00002000:00100000:2.0:1787829884.718419:0:6651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b6abf229-545c-43fd-8dee-d9adf582be48/ffff9e9b7f4e2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787829884.718443:0:6651:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:2.0:1787829884.718668:0:6651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787829884.718697:0:6651:0:(import.c:65:import_set_state_nolock()) ffff9e9b7f4e0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787829884.718766:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+6:2359:x1874675275680384:12345-192.168.201.51@tcp:8:touch.500 Request processed in 434us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829884.718775:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 16 00000100:00100000:0.0:1787829884.721167:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829884.721228:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275680512 00000100:00100000:1.0:1787829884.721237:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275680512 00000100:00100000:1.0:1787829884.721360:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 17 00000100:00100000:1.0:1787829884.721371:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+6:0:x1874675275680512:12345-192.168.201.51@tcp:2:touch.500 00000100:00080000:3.0:1787829884.722450:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787829884.851889:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+7:0:x1874675275680512:12345-192.168.201.51@tcp:2:touch.500 Request processed in 130510us (130720us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787829884.851904:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 17 00000001:00080000:0.0:1787829884.852613:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:0.0:1787829884.852632:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b6abf229-545c-43fd-8dee-d9adf582be48 00000100:00100000:0.0:1787829884.858246:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829884.863548:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275680768 00000100:00100000:2.0:1787829884.863564:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275680768 00000100:00100000:0.0:1787829884.863899:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 2 00000100:00100000:0.0:1787829884.863910:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+10:9708:x1874675275680768:12345-192.168.201.51@tcp:35:touch.500 00000100:00100000:0.0:1787829884.864508:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+11:9708:x1874675275680768:12345-192.168.201.51@tcp:35:touch.500 Request processed in 598us (6270us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787829884.864517:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 2 00000100:00100000:3.0:1787829884.896854:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829884.896944:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275680896 00000100:00100000:1.0:1787829884.896963:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275680896 00000100:00100000:1.0:1787829884.897072:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 25 00000100:00100000:1.0:1787829884.897083:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+11:9709:x1874675275680896:12345-192.168.201.51@tcp:101:rm.0 00010000:00010000:1.0:1787829884.897110:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829884.897133:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d79d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8754 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.897203:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d79d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.897217:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d79d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.897229:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d79d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787829884.897288:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787829884.897291:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787829884.897346:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d79d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.897371:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d79d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8754 expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.897402:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d79d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8754 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.897411:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e9b48f25200) 00010000:00010000:1.0:1787829884.897414:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787829884.897417:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feee600, rc 0) 00000100:00100000:1.0:1787829884.897474:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+12:9709:x1874675275680896:12345-192.168.201.51@tcp:101:rm.0 Request processed in 394us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829884.897486:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 25 00000100:00100000:2.0:1787829884.903601:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829884.903739:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275681152 00000100:00100000:3.0:1787829884.903750:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275681152 00000100:00100000:3.0:1787829884.903842:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 26 00000100:00100000:3.0:1787829884.903852:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+12:9709:x1874675275681152:12345-192.168.201.51@tcp:101:rm.0 00010000:00010000:3.0:1787829884.903874:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829884.903893:0:7257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cb400/0xc03b4d103c0d79de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c875b expref: -99 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829884.904041:0:7257:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787829884.904181:0:7257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cb400/0xc03b4d103c0d79de lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c875b expref: 14 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.904197:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b507a7800) 00010000:00010000:3.0:1787829884.904200:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787829884.904205:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cb400/0xc03b4d103c0d79de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c875b expref: 14 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.904219:0:7257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b596cb400, rc 0) 00000100:00100000:3.0:1787829884.904330:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+13:9709:x1874675275681152:12345-192.168.201.51@tcp:101:rm.0 Request processed in 478us (738us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1787829884.904337:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 26 00000100:00100000:3.0:1787829884.914609:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829884.914721:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275681280 00000100:00100000:1.0:1787829884.914731:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275681280 00000100:00100000:1.0:1787829884.914792:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 3 00000100:00100000:1.0:1787829884.914802:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+13:9709:x1874675275681280:12345-192.168.201.51@tcp:37:rm.0 00000100:00100000:1.0:1787829884.920172:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+13:9709:x1874675275681280:12345-192.168.201.51@tcp:37:rm.0 Request processed in 5358us (5560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829884.920187:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 3 00000100:00100000:2.0:1787829884.929556:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829884.929683:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275681536 00000100:00100000:0.0:1787829884.929693:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275681536 00000100:00100000:0.0:1787829884.929749:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 4 00000100:00100000:0.0:1787829884.929759:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b50361850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+13:9709:x1874675275681536:12345-192.168.201.51@tcp:35:rm.0 00000100:00100000:0.0:1787829884.930113:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b50361850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+14:9709:x1874675275681536:12345-192.168.201.51@tcp:35:rm.0 Request processed in 354us (566us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787829884.930135:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 4 00000100:00100000:3.0:1787829884.935929:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829884.936327:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275681792 00000100:00100000:0.0:1787829884.936338:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275681792 00000100:00100000:0.0:1787829884.936464:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 27 00000100:00100000:0.0:1787829884.936477:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+14:9709:x1874675275681792:12345-192.168.201.51@tcp:101:rm.0 00010000:00010000:0.0:1787829884.936509:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829884.936531:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d79ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8762 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.936661:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d79f3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.936677:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d79f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.936690:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d79f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787829884.936702:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787829884.936836:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d79ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8762 expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.936857:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d79f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8762 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829884.936866:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e9b48f25200) 00010000:00010000:0.0:1787829884.936869:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787829884.936873:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b40030e00, rc 0) 00000100:00100000:0.0:1787829884.937091:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+16:9709:x1874675275681792:12345-192.168.201.51@tcp:101:rm.0 Request processed in 614us (1184us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787829884.937099:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 27 00000100:00100000:0.0:1787829884.942495:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829884.942604:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275681920 00000100:00100000:1.0:1787829884.942614:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275681920 00000100:00100000:1.0:1787829884.942679:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 28 00000100:00100000:1.0:1787829884.942690:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+16:9709:x1874675275681920:12345-192.168.201.51@tcp:41:rm.0 00000004:00000024:1.0:1787829884.942751:0:10044:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1787829884.942869:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+16:9709:x1874675275681920:12345-192.168.201.51@tcp:41:rm.0 Request processed in 180us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829884.942876:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 28 00000100:00100000:2.0:1787829884.946867:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829884.946961:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275682048 00000100:00100000:3.0:1787829884.946971:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275682048 00000100:00100000:1.0:1787829884.947120:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 29 00000100:00100000:1.0:1787829884.947133:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+16:9709:x1874675275682048:12345-192.168.201.51@tcp:101:rm.0 00010000:00010000:1.0:1787829884.947153:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829884.947175:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d7a01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8769 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.947253:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7a08 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.947268:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7a08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.947294:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7a08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.947311:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7a0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.947319:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7a0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.947326:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7a0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.947485:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d7a16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.947494:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d7a16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.947501:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d7a16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787829884.947529:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787829884.947533:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787829884.947550:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d7a16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.947563:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d7a16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.947571:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7a08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.947587:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7a08 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.947593:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7a08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.947600:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feeec00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829884.947604:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7a08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.947612:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7a08 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.947624:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e9b48f25200) 00010000:00010000:1.0:1787829884.947628:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829884.947632:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7a08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.947639:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7a08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.947653:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7a0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.947660:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7a0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.947666:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7a0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.947671:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feef000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829884.947680:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7a0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.947687:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7a0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.947695:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x9f0a7a27 (ffff9e9b507a7a00) 00010000:00010000:1.0:1787829884.947698:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829884.947701:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7a0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.947707:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7a0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.947738:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d7a01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8769 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.947751:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d7a16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8769 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.947758:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e9b478cc400) 00010000:00010000:1.0:1787829884.947760:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787829884.947763:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feee200, rc 0) 00000100:00100000:1.0:1787829884.947882:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+17:9709:x1874675275682048:12345-192.168.201.51@tcp:101:rm.0 Request processed in 752us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829884.947891:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 29 00000100:00100000:0.0:1787829884.953279:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829884.953373:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275682304 00000100:00100000:3.0:1787829884.953393:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275682304 00000100:00100000:3.0:1787829884.953482:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 30 00000100:00100000:3.0:1787829884.953493:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+17:9709:x1874675275682304:12345-192.168.201.51@tcp:36:rm.0 00010000:00010000:3.0:1787829884.953548:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787829884.953576:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d7a16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8769 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.953601:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cbc00/0xc03b4d103c0d79c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c874d expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.953613:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e9b478cc400) 00010000:00010000:3.0:1787829884.953629:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d79d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8754 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.953637:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e9b48f25200) 00010000:00010000:3.0:1787829884.953641:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787829884.953663:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cb400/0xc03b4d103c0d7a1d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.953677:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cb400/0xc03b4d103c0d7a1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.953687:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cb400/0xc03b4d103c0d7a1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.953703:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cac00/0xc03b4d103c0d7a24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.953726:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cac00/0xc03b4d103c0d7a24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.953732:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cac00/0xc03b4d103c0d7a24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.953851:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596ca000/0xc03b4d103c0d7a2b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.953859:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596ca000/0xc03b4d103c0d7a2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.953866:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596ca000/0xc03b4d103c0d7a2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787829884.954876:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1787829884.954889:0:5805:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 264855871194ns, next at 265855868110ns, rc = 0 00010000:00010000:3.0:1787829884.955619:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596ca600/0xc03b4d103c0d7a32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.955635:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596ca600/0xc03b4d103c0d7a32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.955646:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596ca600/0xc03b4d103c0d7a32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.955653:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596ca600/0xc03b4d103c0d7a32 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.955660:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596ca600/0xc03b4d103c0d7a32 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.955681:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596ca600/0xc03b4d103c0d7a32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.955785:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787829884.955810:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596ca000/0xc03b4d103c0d7a2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.955817:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596ca000/0xc03b4d103c0d7a2b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.955824:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596ca000/0xc03b4d103c0d7a2b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.955830:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b596ca000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829884.955834:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596ca000/0xc03b4d103c0d7a2b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.955842:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596ca000/0xc03b4d103c0d7a2b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.955853:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e9b478ccb00) 00010000:00010000:3.0:1787829884.955857:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787829884.955861:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596ca000/0xc03b4d103c0d7a2b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.955868:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596ca000/0xc03b4d103c0d7a2b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.955886:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cb400/0xc03b4d103c0d7a1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.955893:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cb400/0xc03b4d103c0d7a1d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.955905:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cb400/0xc03b4d103c0d7a1d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.955911:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b596cb400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829884.955928:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cb400/0xc03b4d103c0d7a1d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.955936:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cb400/0xc03b4d103c0d7a1d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.955945:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e9b48f25200) 00010000:00010000:3.0:1787829884.955947:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829884.955959:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cb400/0xc03b4d103c0d7a1d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.955972:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cb400/0xc03b4d103c0d7a1d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787829884.955984:0:5805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fae158f reply state 00000000261c170a transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cac00/0xc03b4d103c0d7a24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829884.955992:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787829884.956117:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+16:9709:x1874675275682304:12345-192.168.201.51@tcp:36:rm.0 Request processed in 2622us (2846us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787829884.956126:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 30 00010000:00010000:1.0:1787829884.960761:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cac00/0xc03b4d103c0d7a24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.960778:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cac00/0xc03b4d103c0d7a24 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.960800:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cac00/0xc03b4d103c0d7a24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.960806:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b596cac00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829884.960811:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cac00/0xc03b4d103c0d7a24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.960819:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cac00/0xc03b4d103c0d7a24 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.960836:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x9f0a7a27 (ffff9e9b478cc600) 00010000:00010000:1.0:1787829884.960840:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829884.960845:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cac00/0xc03b4d103c0d7a24 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829884.960851:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596cac00/0xc03b4d103c0d7a24 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.961412:0:11133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787829884.961420:0:11133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596ca600/0xc03b4d103c0d7a32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.961428:0:11133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b596ca600 already unused, calling callback (ffffffffc1651420) 00010000:00010000:2.0:1787829884.961439:0:11133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596ca600/0xc03b4d103c0d7a32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.961448:0:11133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596ca600/0xc03b4d103c0d7a32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.961458:0:11133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e9b478ccb00) 00010000:00010000:2.0:1787829884.961461:0:11133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787829884.961465:0:11133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596ca600/0xc03b4d103c0d7a32 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.961471:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b596ca600/0xc03b4d103c0d7a32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.961493:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829884.961496:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829884.961498:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829884.964791:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829884.964867:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275682560 00000100:00100000:2.0:1787829884.964877:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275682560 00000100:00100000:2.0:1787829884.964945:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 5 00000100:00100000:2.0:1787829884.964956:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ed2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+15:9709:x1874675275682560:12345-192.168.201.51@tcp:35:rm.0 00000100:00100000:2.0:1787829884.965264:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ed2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+16:9709:x1874675275682560:12345-192.168.201.51@tcp:35:rm.0 Request processed in 309us (484us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787829884.965273:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 5 00000100:00100000:0.0:1787829884.977217:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829884.977387:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275682816 00000100:00100000:2.0:1787829884.977400:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275682816 00000100:00100000:2.0:1787829884.977467:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 31 00000100:00100000:2.0:1787829884.977477:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ed30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+16:9709:x1874675275682816:12345-192.168.201.51@tcp:36:rm.0 00010000:00010000:2.0:1787829884.977544:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787829884.977586:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d79f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8762 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.977608:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d7991 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c873f expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.977617:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e9b48f25200) 00010000:00010000:2.0:1787829884.977629:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b48cda200/0xc03b4d103c0d7952 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8731 expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.977635:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b507a7800) 00010000:00010000:2.0:1787829884.977639:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787829884.977659:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fe00/0xc03b4d103c0d7a39 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.977669:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fe00/0xc03b4d103c0d7a39 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.977675:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fe00/0xc03b4d103c0d7a39 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.977682:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7a40 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.977687:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7a40 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.977691:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7a40 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.977915:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7a47 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.977924:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7a47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.977929:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7a47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787829884.978718:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787829884.978734:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7a47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.978741:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7a47 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.978747:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7a47 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.978759:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f200 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829884.978763:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7a47 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.978771:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7a47 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.978782:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e9b45193a00) 00010000:00010000:2.0:1787829884.978785:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787829884.978789:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7a47 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.978795:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7a47 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.978813:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fe00/0xc03b4d103c0d7a39 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.978827:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fe00/0xc03b4d103c0d7a39 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.978832:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fe00/0xc03b4d103c0d7a39 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.978837:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3fe00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829884.978840:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fe00/0xc03b4d103c0d7a39 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.978846:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fe00/0xc03b4d103c0d7a39 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.978854:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b45193200) 00010000:00010000:2.0:1787829884.978857:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829884.978859:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fe00/0xc03b4d103c0d7a39 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829884.978864:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fe00/0xc03b4d103c0d7a39 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787829884.978875:0:5804:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e16bd560 reply state 00000000de67f0b4 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7a40 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829884.978884:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787829884.979517:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ed30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+15:9709:x1874675275682816:12345-192.168.201.51@tcp:36:rm.0 Request processed in 2037us (2305us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787829884.979528:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 31 00010000:00010000:3.0:1787829884.983316:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7a40 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.983334:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7a40 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.983359:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7a40 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.983366:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3e600 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829884.983371:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7a40 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.983389:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7a40 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.983405:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e9b45193900) 00010000:00010000:3.0:1787829884.983409:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829884.983414:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7a40 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829884.983420:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7a40 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829885.602223:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829886.626465:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829886.823093:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284102784:0@lo:400:kworker.0 00000100:00100000:1.0:1787829886.823203:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829886.823281:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787829886.823288:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284102400:0@lo:400:kworker.0 00000100:00100000:1.0:1787829886.823318:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829886.823340:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284102912:0@lo:400:kworker.0 00000100:00100000:1.0:1787829886.823376:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829886.823405:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874675284102528:0@lo:400:kworker.0 00000100:00100000:1.0:1787829886.823428:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829886.823456:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284103040:0@lo:400:kworker.0 00000100:00100000:1.0:1787829886.823478:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829886.823495:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787829886.823500:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284102656:0@lo:400:kworker.0 00000100:00100000:1.0:1787829886.823521:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829886.823555:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284102912 00000100:00100000:1.0:1787829886.823564:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284102912 00000100:00100000:1.0:1787829886.823626:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284102528 00000100:00100000:1.0:1787829886.823629:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284102528 00000100:00100000:1.0:1787829886.823646:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284102656 00000100:00100000:1.0:1787829886.823648:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284102656 00000100:00100000:1.0:1787829886.823668:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787829886.823818:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1874675284102912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829886.823886:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1874675284102912:12345-0@lo:400:kworker.0 Request processed in 209us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829886.823894:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787829886.823914:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787829886.823920:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874675284102528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829886.823953:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874675284102528:12345-0@lo:400:kworker.0 Request processed in 33us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829886.823959:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787829886.823969:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787829886.823976:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284102656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829886.824004:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284102656:12345-0@lo:400:kworker.0 Request processed in 30us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829886.824010:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787829886.824063:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284102784 00000100:00100000:1.0:1787829886.824074:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284102784 00000100:00100000:1.0:1787829886.824101:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284103040 00000100:00100000:1.0:1787829886.824104:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284103040 00000004:00080000:0.0:1787829886.824411:0:6746:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 266725392411ns, next at 267725389281ns, rc = 0 00000100:00080000:0.0:1787829886.824533:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787829886.824539:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787829886.824552:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787829886.824643:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284102656:0@lo:400:kworker.0 00000100:00100000:0.0:1787829886.824702:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874675284102528:0@lo:400:kworker.0 00000100:00100000:0.0:1787829886.824738:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787829886.824762:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284103168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787829886.824847:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829886.824959:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284102912:0@lo:400:kworker.0 00000100:00100000:0.0:1787829886.825073:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284103168 00000100:00100000:0.0:1787829886.825078:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284103168 00000100:00100000:0.0:1787829886.825170:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787829886.825195:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1874675284103168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787829886.825295:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787829886.825397:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1874675284103168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 203us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829886.825416:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1787829886.825480:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7fa452c0 x1874675284103168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829886.825538:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284103168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787829886.826067:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787829886.826094:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284102784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829886.826238:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284102784:12345-0@lo:400:kworker.0 Request processed in 149us (3035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829886.826255:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787829886.826269:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787829886.826286:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284103040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829886.826358:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284103040:12345-0@lo:400:kworker.0 Request processed in 82us (2879us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829886.826365:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787829886.826400:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284102400 00000100:00100000:2.0:1787829886.826406:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284102400 00000100:00100000:2.0:1787829886.826455:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787829886.826463:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3278:x1874675284102400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829886.826519:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3278:x1874675284102400:12345-0@lo:400:kworker.0 Request processed in 57us (3200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829886.826525:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00010000:00080000:2.0:1787829886.826618:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f4c5a40 x1874675284103040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829886.826642:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284103040:0@lo:400:kworker.0 00000100:00100000:1.0:1787829886.827282:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284102400:0@lo:400:kworker.0 00010000:00080000:1.0:1787829886.827314:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f4c61c0 x1874675284102784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829886.827325:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284102784:0@lo:400:kworker.0 00000100:00100000:0.0:1787829887.330407:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284103296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787829887.330518:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829887.330987:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284103296 00000100:00100000:3.0:1787829887.330999:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284103296 00000100:00100000:3.0:1787829887.331080:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787829887.331092:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284103296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787829887.331140:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787829887.331215:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284103296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829887.331223:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1787829887.331263:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f4c61c0 x1874675284103296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829887.331353:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284103296:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787829887.656294:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829888.674258:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829888.801121:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829888.801501:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275682944 00000100:00100000:3.0:1787829888.801535:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275682944 00000100:00100000:3.0:1787829888.801617:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 251 00000100:00100000:3.0:1787829888.801629:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69c97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2362:x1874675275682944:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829888.801730:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69c97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2362:x1874675275682944:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 103us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829888.801739:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 251 00000100:00100000:1.0:1787829888.802078:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829888.803004:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275683072 00000100:00100000:2.0:1787829888.803085:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275683072 00000100:00100000:2.0:1787829888.803174:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 103 00000100:00100000:2.0:1787829888.803187:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+14:2362:x1874675275683072:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829888.803282:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+14:2362:x1874675275683072:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 98us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829888.803319:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 103 00000100:00080000:0.0:1787829888.804540:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787829888.811417:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829888.811478:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829888.812000:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275683200 00000100:00100000:2.0:1787829888.812050:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275683200 00000100:00100000:2.0:1787829888.812172:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 46 00000100:00100000:2.0:1787829888.812185:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b47a79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+5:2362:x1874675275683200:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829888.812293:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b47a79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+5:2362:x1874675275683200:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 112us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829888.812302:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 46 00000100:00100000:0.0:1787829888.812406:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275683328 00000100:00100000:0.0:1787829888.812412:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275683328 00000100:00100000:0.0:1787829888.812478:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 104 00000100:00100000:0.0:1787829888.812486:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b47a78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:902200d4-578b-4474-a651-ffe6603128fa+5:2363:x1874675275683328:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787829888.812524:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b47a78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:902200d4-578b-4474-a651-ffe6603128fa+5:2363:x1874675275683328:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 39us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829888.812531:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 104 00000100:00080000:3.0:1787829888.813237:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787829888.813245:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787829889.699079:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787829889.729013:0:11582:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:3.0:1787829889.969243:0:5827:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1787829889.969274:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967305 is committed 00000001:00080000:3.0:1787829889.969311:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1787829889.969319:0:5827:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1787829889.969542:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b47a78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284103424:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787829889.969646:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829889.969801:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284103424 00000100:00100000:0.0:1787829889.969812:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284103424 00000100:00100000:0.0:1787829889.970053:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787829889.970068:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284103424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787829889.970106:0:8603:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00000100:00080000:3.0:1787829889.970321:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1787829889.970926:0:8603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a901e7d, atime: 0x6a901e7d, ctime: 0x6a901e7d, blocks: 0x1 00010000:00010000:0.0:1787829889.970941:0:8603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa36e096/0xc03b4d103c0d7a4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829889.970963:0:8603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=269s v=(0 0) 00010000:00010000:0.0:1787829889.970968:0:8603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787829889.970985:0:8603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa36e096/0xc03b4d103c0d7a4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829889.971007:0:8603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa36e096/0xc03b4d103c0d7a4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829889.971041:0:8603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa36e096/0xc03b4d103c0d7a4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829889.971050:0:8603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa36e096/0xc03b4d103c0d7a4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829889.971078:0:8603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787829889.972278:0:11133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787829889.972306:0:11133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa36e096/0xc03b4d103c0d7a4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829889.972321:0:11133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40031200 already unused, calling callback (ffffffffc1651420) 00010000:00010000:3.0:1787829889.972326:0:11133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa36e096/0xc03b4d103c0d7a4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829889.972339:0:11133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa36e096/0xc03b4d103c0d7a4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829889.972372:0:11133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa36e096/0xc03b4d103c0d7a4e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829889.972400:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa36e096/0xc03b4d103c0d7a4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829889.972433:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829889.972435:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829889.972437:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829889.976344:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3279:x1874675284103424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6273us (6690us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787829889.976360:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1787829889.976522:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e9b47a78b40/2, rc 0, transno 4294967300 00000100:00100000:0.0:1787829889.976538:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b47a78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284103424:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787829890.725764:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787829891.124308:0:11631:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe32cca500 20000000:00000080:1.0:1787829891.124327:0:11631:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e9b7fe72800 uarg=0000000000000000 20000000:01000000:1.0:1787829891.124367:0:11631:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787829891.124373:0:11631:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787829891.124379:0:11631:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1787829891.129675:0:11632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1787829891.130432:0:11631:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1787829891.142114:0:11631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1787829891.142199:0:11631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1787829891.142251:0:11631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1787829891.142340:0:11631:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787829891.142373:0:11631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d7a55 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829891.142394:0:11631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b596cb800/0xc03b4d103c0d78f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c871c expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829891.142402:0:11631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b48cdb400/0xc03b4d103c0d78f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8723 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829891.142410:0:11631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b74e3e400/0xc03b4d103c0d7905 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d78fe expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829891.142416:0:11631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b74e3ee00/0xc03b4d103c0d7913 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d790c expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829891.142423:0:11631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b74e3f800/0xc03b4d103c0d7921 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d791a expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829891.142431:0:11631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d7a55 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829891.142477:0:11631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b74e3f800/0xc03b4d103c0d7921 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d791a expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829891.142492:0:11631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e9b74e3f800/0xc03b4d103c0d7921 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d791a expref: 18 pid: 5799 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829891.142506:0:11631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1874675284103552:0@lo:104: 00000100:00100000:1.0:1787829891.142582:0:11631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787829891.142695:0:11631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b74e3ee00/0xc03b4d103c0d7913 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d790c expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829891.142716:0:11631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e9b74e3ee00/0xc03b4d103c0d7913 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d790c expref: 18 pid: 5799 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829891.142725:0:11631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c5a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1874675284103680:0@lo:104: 00000100:00100000:1.0:1787829891.142747:0:11631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787829891.146387:0:11631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b74e3e400/0xc03b4d103c0d7905 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d78fe expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829891.146408:0:11631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e9b74e3e400/0xc03b4d103c0d7905 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d78fe expref: 18 pid: 5798 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829891.146421:0:11631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c7840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1874675284103808:0@lo:104: 00000100:00100000:1.0:1787829891.146487:0:11631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829891.146603:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284103552 00000100:00100000:2.0:1787829891.146611:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284103552 00000100:00100000:2.0:1787829891.146657:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284103680 00000100:00100000:2.0:1787829891.146660:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284103680 00000100:00100000:2.0:1787829891.146676:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787829891.146685:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+4:11631:x1874675284103552:12345-0@lo:104: 00010000:00010000:2.0:1787829891.146698:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb200/0xc03b4d103c0d791a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d7921 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829891.146759:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787829891.146765:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+4:11631:x1874675284103552:12345-0@lo:104: Request processed in 82us (4184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829891.146772:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787829891.146804:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787829891.146818:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:11631:x1874675284103680:12345-0@lo:104: 00010000:00010000:2.0:1787829891.146826:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda400/0xc03b4d103c0d790c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d7913 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829891.146881:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787829891.146887:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:11631:x1874675284103680:12345-0@lo:104: Request processed in 77us (4139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829891.146893:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1787829891.146912:0:11133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787829891.146918:0:11133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb200/0xc03b4d103c0d791a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d7921 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829891.146926:0:11133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b596cb200 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:2.0:1787829891.146930:0:11133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb200/0xc03b4d103c0d791a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d7921 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829891.146939:0:11133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb200/0xc03b4d103c0d791a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d7921 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787829891.146945:0:11133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb200/0xc03b4d103c0d791a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d7921 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787829891.146951:0:11133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787829891.146981:0:11133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb200/0xc03b4d103c0d791a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7921 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829891.146988:0:11133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787829891.147006:0:11133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb200/0xc03b4d103c0d791a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7921 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829891.147013:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b596cb200/0xc03b4d103c0d791a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7921 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829891.147079:0:11133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787829891.147082:0:11133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda400/0xc03b4d103c0d790c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d7913 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829891.147087:0:11133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b48cda400 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:2.0:1787829891.147090:0:11133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda400/0xc03b4d103c0d790c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d7913 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829891.147097:0:11133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda400/0xc03b4d103c0d790c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d7913 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787829891.147102:0:11133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda400/0xc03b4d103c0d790c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d7913 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787829891.147107:0:11133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787829891.147121:0:11133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda400/0xc03b4d103c0d790c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7913 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829891.147126:0:11133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787829891.147132:0:11133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda400/0xc03b4d103c0d790c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7913 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829891.147138:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda400/0xc03b4d103c0d790c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7913 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829891.147146:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829891.147148:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829891.147149:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787829891.147171:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284103936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787829891.147206:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829891.147241:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787829891.147248:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284104064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787829891.147291:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829891.147321:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284103936 00000100:00100000:2.0:1787829891.147325:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284103936 00010000:00010000:2.0:1787829891.147345:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b74e3f800/0xc03b4d103c0d7921 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d791a expref: 19 pid: 5799 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829891.147363:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284104064 00000100:00100000:2.0:1787829891.147366:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284104064 00010000:00010000:2.0:1787829891.147378:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b74e3ee00/0xc03b4d103c0d7913 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d790c expref: 20 pid: 5799 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829891.147394:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787829891.147401:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+20:3280:x1874675284103936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787829891.147410:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829891.147415:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b74e3f800/0xc03b4d103c0d7921 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d791a expref: 20 pid: 5799 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829891.147425:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b74e3f800/0xc03b4d103c0d7921 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d791a expref: 20 pid: 5799 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829891.147442:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787829891.147469:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+20:3280:x1874675284103936:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829891.147477:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787829891.147490:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787829891.147496:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3280:x1874675284104064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787829891.147512:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829891.147516:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b74e3ee00/0xc03b4d103c0d7913 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d790c expref: 19 pid: 5799 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829891.147524:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b74e3ee00/0xc03b4d103c0d7913 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d790c expref: 19 pid: 5799 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829891.147533:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787829891.147556:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3280:x1874675284104064:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829891.147562:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787829891.147602:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284104064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787829891.147610:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284103936:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787829891.147933:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829891.148474:0:11631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b48cdb400/0xc03b4d103c0d78f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8723 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829891.148491:0:11631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9b48cdb400/0xc03b4d103c0d78f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8723 expref: 12 pid: 5799 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829891.148503:0:11631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1874675284104192:192.168.201.51@tcp:104: 00010000:00010000:1.0:1787829891.148626:0:11631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b596cb800/0xc03b4d103c0d78f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c871c expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829891.148635:0:11631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9b596cb800/0xc03b4d103c0d78f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c871c expref: 12 pid: 5798 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829891.148644:0:11631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1874675284104320:192.168.201.51@tcp:104: 00000100:00100000:1.0:1787829891.148667:0:11631:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4998a900 going to sleep for 11 seconds 00010000:00010000:1.0:1787829891.148697:0:11631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b74e3f800/0xc03b4d103c0d7921 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d791a expref: 18 pid: 5799 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829891.148708:0:11631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1874675284103552:0@lo:104: 00010000:00010000:1.0:1787829891.148718:0:11631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b74e3ee00/0xc03b4d103c0d7913 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d790c expref: 17 pid: 5799 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829891.148726:0:11631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c5a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1874675284103680:0@lo:104: 00000100:00100000:2.0:1787829891.148816:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787829891.148828:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284103808 00000100:00100000:2.0:1787829891.148833:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284103808 00000100:00100000:2.0:1787829891.148865:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787829891.148872:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b76a2c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:11631:x1874675284103808:12345-0@lo:104: 00010000:00010000:2.0:1787829891.148884:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdba00/0xc03b4d103c0d78fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d7905 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829891.148950:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787829891.148956:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b76a2c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+3:11631:x1874675284103808:12345-0@lo:104: Request processed in 85us (2470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829891.148963:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1787829891.149004:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787829891.149011:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdba00/0xc03b4d103c0d78fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d7905 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829891.149052:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b48cdba00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:2.0:1787829891.149057:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdba00/0xc03b4d103c0d78fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d7905 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829891.149066:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdba00/0xc03b4d103c0d78fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d7905 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787829891.149073:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdba00/0xc03b4d103c0d78fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d7905 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787829891.149079:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787829891.149106:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdba00/0xc03b4d103c0d78fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7905 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829891.149113:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787829891.149132:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdba00/0xc03b4d103c0d78fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7905 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829891.149139:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdba00/0xc03b4d103c0d78fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d7905 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829891.149155:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829891.149157:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829891.149159:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787829891.149171:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284104448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787829891.149200:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829891.149239:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284104448 00000100:00100000:2.0:1787829891.149243:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284104448 00000100:00100000:1.0:1787829891.149683:0:11631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c7840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1874675284103808:0@lo:104: 00010000:00010000:2.0:1787829891.149761:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b74e3e400/0xc03b4d103c0d7905 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d78fe expref: 17 pid: 5798 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829891.149897:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787829891.149906:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b51a06c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:3278:x1874675284104448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787829891.149917:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829891.149921:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b74e3e400/0xc03b4d103c0d7905 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d78fe expref: 17 pid: 5798 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829891.149931:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b74e3e400/0xc03b4d103c0d7905 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d78fe expref: 17 pid: 5798 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829891.149945:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b74e3e400/0xc03b4d103c0d7905 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d78fe expref: 17 pid: 5798 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829891.149957:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787829891.149993:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b51a06c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:3278:x1874675284104448:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829891.149999:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787829891.150318:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284104448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787829891.153122:0:11631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1874675284104192:192.168.201.51@tcp:104: 00000100:00100000:1.0:1787829891.153138:0:11631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1874675284104320:192.168.201.51@tcp:104: 00010000:00010000:1.0:1787829891.153171:0:11631:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d7a55 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829891.161364:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829891.161410:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829891.161503:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275683584 00000100:00100000:0.0:1787829891.161513:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275683584 00010000:00010000:0.0:1787829891.161555:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b596cb800/0xc03b4d103c0d78f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c871c expref: 13 pid: 5798 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829891.161591:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275683456 00000100:00100000:0.0:1787829891.161594:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275683456 00010000:00010000:0.0:1787829891.161607:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b48cdb400/0xc03b4d103c0d78f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8723 expref: 14 pid: 5799 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829891.161640:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 33 00000100:00100000:0.0:1787829891.161650:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aaccd34-1037-4ac9-aa31-e92ce8889520+14:2363:x1874675275683584:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787829891.161692:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829891.161699:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b596cb800/0xc03b4d103c0d78f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c871c expref: 14 pid: 5798 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829891.161713:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b596cb800/0xc03b4d103c0d78f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c871c expref: 14 pid: 5798 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829891.161733:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b596cb800/0xc03b4d103c0d78f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c871c expref: 14 pid: 5798 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829891.161750:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829891.161824:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2363:x1874675275683584:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 174us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829891.161832:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 33 00000100:00100000:0.0:1787829891.161852:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 34 00000100:00100000:0.0:1787829891.161871:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aaccd34-1037-4ac9-aa31-e92ce8889520+12:2363:x1874675275683456:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787829891.161879:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829891.161884:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b48cdb400/0xc03b4d103c0d78f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8723 expref: 12 pid: 5799 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829891.161893:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b48cdb400/0xc03b4d103c0d78f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8723 expref: 12 pid: 5799 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829891.161904:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b48cdb400/0xc03b4d103c0d78f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8723 expref: 12 pid: 5799 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829891.161915:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d7a55 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829891.161935:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d7a55 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829891.161952:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d7a55 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829891.161959:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d7a55 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829891.161966:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d7a55 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829891.161972:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d7a55 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829891.161977:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feef800 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787829891.161981:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d7a55 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829891.161989:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d7a55 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829891.162000:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d7a55 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829891.162010:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829891.162059:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aaccd34-1037-4ac9-aa31-e92ce8889520+11:2363:x1874675275683456:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 189us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829891.162067:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 34 00010000:00010000:1.0:1787829891.162223:0:11631:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d7a55 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829891.162231:0:11631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d7a55 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829891.162238:0:11631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d7a55 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829891.746249:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787829891.939289:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284104704:0@lo:400:kworker.0 00000100:00100000:2.0:1787829891.939378:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829891.939460:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787829891.939467:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284104832:0@lo:400:kworker.0 00000100:00100000:2.0:1787829891.939495:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829891.939534:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284104832 00000100:00100000:2.0:1787829891.939541:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284104832 00000100:00100000:2.0:1787829891.939620:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787829891.939630:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3280:x1874675284104832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829891.939692:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3280:x1874675284104832:12345-0@lo:400:kworker.0 Request processed in 55us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829891.939714:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787829891.939756:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284104832:0@lo:400:kworker.0 00000100:00100000:3.0:1787829891.940540:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284104960:0@lo:400:kworker.0 00000100:00100000:3.0:1787829891.940585:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829891.940611:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787829891.940619:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284104576:0@lo:400:kworker.0 00000100:00100000:3.0:1787829891.940661:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829891.940685:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284105088:0@lo:400:kworker.0 00000100:00100000:3.0:1787829891.940709:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787829891.940744:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787829891.940771:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284104704 00000100:00100000:3.0:1787829891.940776:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284104704 00000100:00100000:3.0:1787829891.940814:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284104960 00000100:00100000:3.0:1787829891.940818:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284104960 00000100:00100000:3.0:1787829891.940835:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284104576 00000100:00100000:3.0:1787829891.940837:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284104576 00000100:00100000:3.0:1787829891.940850:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787829891.940857:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284104704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829891.940911:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284104704:12345-0@lo:400:kworker.0 Request processed in 55us (1534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829891.940926:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787829891.940940:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787829891.940947:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b47a79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1874675284104960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829891.940983:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b47a79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1874675284104960:12345-0@lo:400:kworker.0 Request processed in 36us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829891.940989:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787829891.941001:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787829891.941007:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f328b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284104576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829891.941160:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f328b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284104576:12345-0@lo:400:kworker.0 Request processed in 152us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829891.941168:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787829891.941186:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284105088 00000100:00100000:3.0:1787829891.941189:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284105088 00000100:00100000:3.0:1787829891.941211:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787829891.941216:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f32ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284105088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829891.941245:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f32ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284105088:12345-0@lo:400:kworker.0 Request processed in 29us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829891.941252:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1787829891.941277:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787829891.941281:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787829891.941302:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284104576:0@lo:400:kworker.0 00010000:00080000:3.0:1787829891.941316:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f4c6580 x1874675284105088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829891.941327:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284105088:0@lo:400:kworker.0 00000100:00100000:3.0:1787829891.941337:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284104960:0@lo:400:kworker.0 00000100:00100000:2.0:1787829891.941578:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284104704:0@lo:400:kworker.0 00000100:00100000:0.0:1787829891.941802:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787829891.941819:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f328780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284105216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787829891.941855:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829891.942003:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284105216 00000100:00100000:3.0:1787829891.942008:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284105216 00000100:00100000:3.0:1787829891.942072:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787829891.942080:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1874675284105216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787829891.942108:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787829891.942145:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1874675284105216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829891.942151:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787829891.942317:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f328780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284105216:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1787829892.258166:0:5802:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787829892.258178:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9b7f524800 from 7 10000000:01000000:2.0:1787829892.258185:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787829892.258262:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e400/0xc03b4d103c0d7a5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829892.258275:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e400/0xc03b4d103c0d7a5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829892.258288:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e400/0xc03b4d103c0d7a5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829892.258315:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284105344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787829892.258388:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829892.258519:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51e6e900 going to sleep for 11 seconds 00000100:00100000:1.0:1787829892.260154:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284105344 00000100:00100000:1.0:1787829892.260168:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284105344 00000100:00100000:1.0:1787829892.260316:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787829892.260328:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69c95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:5802:x1874675284105344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787829892.260360:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829892.260382:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d7a63 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d7a5c expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829892.260410:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d7a63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d7a5c expref: 17 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829892.260422:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d7a63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7a5c expref: 17 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829892.260432:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feef800, rc 0) 00000100:00100000:1.0:1787829892.260523:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69c95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284105344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (2133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829892.260531:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787829892.260629:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284105344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787829892.260646:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e400/0xc03b4d103c0d7a5c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7a63 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829892.260656:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e400/0xc03b4d103c0d7a5c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d7a63 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829892.260739:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f32b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284105472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787829892.260776:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829892.261262:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b8196ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787829892.261344:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284105472 00000100:00100000:2.0:1787829892.261349:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284105472 00000100:00100000:2.0:1787829892.261379:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787829892.261386:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284105472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787829892.261653:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284105472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829892.261660:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787829892.261758:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f32b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284105472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787829892.261803:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f32b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284105600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787829892.261841:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829892.261870:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b8196ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787829892.263302:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284105600 00000100:00100000:1.0:1787829892.263313:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284105600 00000100:00100000:1.0:1787829892.263365:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787829892.263374:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69c95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284105600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787829892.263606:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69c95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284105600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 231us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829892.263613:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787829892.265864:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f32b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284105600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787829892.266405:0:11644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f32b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:11644:1874675284105728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787829892.266487:0:11644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829892.266538:0:11644:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b8196ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1787829892.266677:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284105728 00000100:00100000:1.0:1787829892.266684:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284105728 00000100:00100000:1.0:1787829892.266904:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787829892.266914:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:11644:x1874675284105728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787829892.267196:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:11644:x1874675284105728:12345-0@lo:502:llog_process_th.0 Request processed in 284us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829892.267214:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787829892.267310:0:11644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f32b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:11644:1874675284105728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787829892.267337:0:11644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787829892.267347:0:11644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787829892.267349:0:11644:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787829892.267356:0:11644:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e9b7f524800 00000020:00000080:3.0:1787829892.267358:0:11644:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787829892.269404:0:11644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f32b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:11644:1874675284105856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787829892.269482:0:11644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829892.270562:0:11644:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b8196ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1787829892.277977:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284105856 00000100:00100000:0.0:1787829892.277993:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284105856 00000100:00100000:0.0:1787829892.278065:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787829892.278076:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:11644:x1874675284105856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787829892.278373:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:11644:x1874675284105856:12345-0@lo:502:llog_process_th.0 Request processed in 298us (8890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829892.278381:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787829892.278455:0:11644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f32b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:11644:1874675284105856:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787829892.278489:0:11644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787829892.278497:0:11644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787829892.278500:0:11644:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787829892.278505:0:11644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787829892.279095:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787829892.279117:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787829892.279128:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e400/0xc03b4d103c0d7a5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7a63 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829892.279138:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e400/0xc03b4d103c0d7a5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7a63 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787829892.279148:0:5802:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787829892.279151:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9b53977800 from 7 10000000:01000000:0.0:1787829892.279154:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787829892.279187:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d7a6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829892.279211:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d7a6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829892.279221:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d7a6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829892.279243:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284105984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787829892.279300:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829892.279336:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4fa23540 going to sleep for 11 seconds 00000100:00100000:0.0:1787829892.279352:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284105984 00000100:00100000:0.0:1787829892.279356:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284105984 00000100:00100000:0.0:1787829892.279384:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787829892.279392:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:5802:x1874675284105984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787829892.279403:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829892.279417:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b40030400/0xc03b4d103c0d7a71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d7a6a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829892.279439:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b40030400/0xc03b4d103c0d7a71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d7a6a expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829892.279449:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b40030400/0xc03b4d103c0d7a71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7a6a expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829892.279457:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b40030400, rc 0) 00000100:00100000:0.0:1787829892.279487:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284105984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829892.279494:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787829892.279537:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284105984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787829892.279550:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d7a6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7a71 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829892.279559:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d7a6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d7a71 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829892.279602:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284106112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787829892.279628:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829892.279642:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4fa23540 going to sleep for 11 seconds 00000100:00100000:0.0:1787829892.279653:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284106112 00000100:00100000:0.0:1787829892.279656:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284106112 00000100:00100000:0.0:1787829892.279671:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787829892.279676:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284106112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787829892.283060:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284106112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3372us (3419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829892.283073:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787829892.283144:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284106112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787829892.283198:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284106240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787829892.283246:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829892.283278:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4fa23540 going to sleep for 11 seconds 00000100:00100000:0.0:1787829892.283296:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284106240 00000100:00100000:0.0:1787829892.283302:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284106240 00000100:00100000:0.0:1787829892.283330:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787829892.283336:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284106240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787829892.283500:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284106240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829892.283513:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787829892.283552:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284106240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787829892.283735:0:11647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:11647:1874675284106368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787829892.283768:0:11647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829892.283787:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284106368 00000100:00100000:0.0:1787829892.283791:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284106368 00000100:00100000:0.0:1787829892.283808:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787829892.283814:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:11647:x1874675284106368:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787829892.284348:0:11647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4fa23480 going to sleep for 11 seconds 00000100:00100000:2.0:1787829892.289503:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:11647:x1874675284106368:12345-0@lo:502:llog_process_th.0 Request processed in 5678us (5724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829892.289533:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787829892.289709:0:11647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:11647:1874675284106368:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787829892.289753:0:11647:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787829892.289763:0:11647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787829892.289765:0:11647:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787829892.289771:0:11647:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e9b53977800 00000020:00000080:0.0:1787829892.289773:0:11647:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787829892.289874:0:11647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:11647:1874675284106496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787829892.289915:0:11647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829892.289946:0:11647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4fa23480 going to sleep for 11 seconds 00000040:00080000:3.0:1787829892.295525:0:11648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787829892.302011:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284106496 00000100:00100000:2.0:1787829892.302052:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284106496 00000100:00100000:2.0:1787829892.302125:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787829892.302136:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:11647:x1874675284106496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787829892.302436:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:11647:x1874675284106496:12345-0@lo:502:llog_process_th.0 Request processed in 302us (12520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829892.302443:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787829892.304213:0:11647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:11647:1874675284106496:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787829892.304265:0:11647:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787829892.304274:0:11647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787829892.304276:0:11647:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787829892.304281:0:11647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787829892.304557:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787829892.304578:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787829892.304590:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d7a6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7a71 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829892.304601:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d7a6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7a71 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787829892.304612:0:5802:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787829892.304615:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9b51a3b000 from 7 10000000:01000000:2.0:1787829892.304617:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787829892.304655:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3fc00/0xc03b4d103c0d7a78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829892.304663:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3fc00/0xc03b4d103c0d7a78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829892.304672:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3fc00/0xc03b4d103c0d7a78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829892.304694:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284106624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787829892.304775:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829892.304820:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51e6e480 going to sleep for 11 seconds 00000100:00100000:1.0:1787829892.304944:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284106624 00000100:00100000:1.0:1787829892.304950:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284106624 00000100:00100000:1.0:1787829892.304994:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787829892.305002:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:5802:x1874675284106624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787829892.305014:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829892.305048:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b7feefe00/0xc03b4d103c0d7a7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d7a78 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829892.305070:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b7feefe00/0xc03b4d103c0d7a7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d7a78 expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829892.305080:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b7feefe00/0xc03b4d103c0d7a7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d7a78 expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829892.305088:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feefe00, rc 0) 00000100:00100000:1.0:1787829892.305137:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:5802:x1874675284106624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829892.305144:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787829892.305180:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284106624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787829892.305192:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3fc00/0xc03b4d103c0d7a78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7a7f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829892.305213:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3fc00/0xc03b4d103c0d7a78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d7a7f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829892.305275:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284106752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787829892.305302:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829892.305318:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b431ba240 going to sleep for 11 seconds 00000100:00100000:1.0:1787829892.305330:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284106752 00000100:00100000:1.0:1787829892.305333:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284106752 00000100:00100000:1.0:1787829892.305354:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787829892.305360:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:5802:x1874675284106752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787829892.305754:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:5802:x1874675284106752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 392us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829892.305762:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787829892.305794:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284106752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787829892.305824:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284106880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787829892.305863:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829892.305877:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b431ba240 going to sleep for 11 seconds 00000100:00100000:1.0:1787829892.305889:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284106880 00000100:00100000:1.0:1787829892.305892:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284106880 00000100:00100000:1.0:1787829892.305910:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787829892.305915:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:5802:x1874675284106880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787829892.306085:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:5802:x1874675284106880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829892.306092:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787829892.306449:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ff77d2d-a894-4919-b9b2-0fa36523bae1:5802:1874675284106880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787829892.312460:0:11649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f329e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:11649:1874675284107008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787829892.313256:0:11649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829892.313307:0:11649:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b8196a900 going to sleep for 11 seconds 00000100:00100000:0.0:1787829892.313454:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284107008 00000100:00100000:0.0:1787829892.313463:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284107008 00000100:00100000:0.0:1787829892.313675:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787829892.313686:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:11649:x1874675284107008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787829892.313939:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:11649:x1874675284107008:12345-0@lo:502:llog_process_th.0 Request processed in 255us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829892.313956:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787829892.316446:0:11649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f329e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:11649:1874675284107008:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787829892.316489:0:11649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787829892.316500:0:11649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787829892.316503:0:11649:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787829892.316510:0:11649:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e9b51a3b000 00000020:00000080:3.0:1787829892.316513:0:11649:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787829892.316627:0:11649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f329e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:11649:1874675284107136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787829892.316694:0:11649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829892.322617:0:11649:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b8196a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787829892.325242:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284107136 00000100:00100000:1.0:1787829892.325268:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284107136 00000100:00100000:1.0:1787829892.325374:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787829892.325385:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:11649:x1874675284107136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787829892.326427:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:11649:x1874675284107136:12345-0@lo:502:llog_process_th.0 Request processed in 1040us (9729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829892.326437:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787829892.327272:0:11649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f329e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ff77d2d-a894-4919-b9b2-0fa36523bae1:11649:1874675284107136:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787829892.327312:0:11649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787829892.327329:0:11649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787829892.327331:0:11649:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787829892.327336:0:11649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787829892.327660:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787829892.327684:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787829892.327695:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3fc00/0xc03b4d103c0d7a78 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7a7f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829892.327706:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3fc00/0xc03b4d103c0d7a78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7a7f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829892.451618:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787829892.451644:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284107264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787829892.451721:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829892.453885:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284107264 00000100:00100000:3.0:1787829892.453898:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284107264 00000100:00100000:3.0:1787829892.453950:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787829892.453959:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ebc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284107264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787829892.453997:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787829892.454134:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ebc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284107264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 175us (2413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829892.454142:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1787829892.454651:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f4c4f00 x1874675284107264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829892.454675:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284107264:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787829892.770818:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787829892.958260:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829892.959665:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275683712 00000100:00100000:0.0:1787829892.959680:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275683712 00000100:00100000:0.0:1787829892.959765:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 267 00000100:00100000:0.0:1787829892.959776:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+11:5602:x1874675275683712:12345-192.168.201.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787829892.959794:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829892.959814:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b40030e00/0xc03b4d103c0d7a86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x53172783628c8770 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829892.959843:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b40030e00/0xc03b4d103c0d7a86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8770 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829892.959856:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b40030e00/0xc03b4d103c0d7a86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8770 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829892.959865:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b40030e00, rc 0) 00000100:00100000:0.0:1787829892.959930:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+12:5602:x1874675275683712:12345-192.168.201.51@tcp:101:ll_cfg_requeue.0 Request processed in 156us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829892.959937:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 267 00000100:00100000:0.0:1787829892.975755:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829892.975867:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275683840 00000100:00100000:2.0:1787829892.975877:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275683840 00000100:00100000:2.0:1787829892.975941:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 268 00000100:00100000:2.0:1787829892.975951:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+12:5602:x1874675275683840:12345-192.168.201.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787829892.976338:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+12:5602:x1874675275683840:12345-192.168.201.51@tcp:501:ll_cfg_requeue.0 Request processed in 387us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829892.976347:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 268 00000100:00100000:1.0:1787829892.981438:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829892.982086:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275683968 00000100:00100000:3.0:1787829892.982097:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275683968 00000100:00100000:3.0:1787829892.982183:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 269 00000100:00100000:3.0:1787829892.982195:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+12:5602:x1874675275683968:12345-192.168.201.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787829892.982441:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+12:5602:x1874675275683968:12345-192.168.201.51@tcp:503:ll_cfg_requeue.0 Request processed in 247us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829892.982449:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 269 00000100:00100000:3.0:1787829892.997770:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829892.997918:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275684096 00000100:00100000:0.0:1787829892.997933:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275684096 00000100:00100000:0.0:1787829892.998014:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 270 00000100:00100000:0.0:1787829892.998051:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+12:9979:x1874675275684096:12345-192.168.201.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787829892.998419:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+12:9979:x1874675275684096:12345-192.168.201.51@tcp:502:llog_process_th.0 Request processed in 370us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829892.998440:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 270 00000100:00100000:0.0:1787829893.003280:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829893.003414:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275684224 00000100:00100000:2.0:1787829893.003427:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275684224 00000100:00100000:2.0:1787829893.003503:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 271 00000100:00100000:2.0:1787829893.003515:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+12:9979:x1874675275684224:12345-192.168.201.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787829893.004348:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+12:9979:x1874675275684224:12345-192.168.201.51@tcp:502:llog_process_th.0 Request processed in 829us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829893.004360:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 271 00000100:00100000:1.0:1787829893.017874:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829893.018104:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275684352 00000100:00100000:0.0:1787829893.018122:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275684352 00000100:00100000:0.0:1787829893.018486:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 272 00000100:00100000:0.0:1787829893.018499:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+12:5602:x1874675275684352:12345-192.168.201.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787829893.018516:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829893.018536:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b40031200/0xc03b4d103c0d7a8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x53172783628c8777 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829893.018566:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b40031200/0xc03b4d103c0d7a8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8777 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829893.018577:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b40031200/0xc03b4d103c0d7a8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8777 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829893.018586:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b40031200, rc 0) 00000100:00100000:0.0:1787829893.018649:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:5602:x1874675275684352:12345-192.168.201.51@tcp:101:ll_cfg_requeue.0 Request processed in 152us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829893.018656:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 272 00000100:00100000:3.0:1787829893.021894:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829893.023561:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275684480 00000100:00100000:2.0:1787829893.023581:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275684480 00000100:00100000:2.0:1787829893.023634:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 273 00000100:00100000:2.0:1787829893.023658:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:5602:x1874675275684480:12345-192.168.201.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787829893.024488:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:5602:x1874675275684480:12345-192.168.201.51@tcp:501:ll_cfg_requeue.0 Request processed in 826us (2600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829893.024499:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 273 00000100:00100000:1.0:1787829893.038245:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829893.038622:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275684608 00000100:00100000:2.0:1787829893.038636:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275684608 00000100:00100000:2.0:1787829893.038702:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 274 00000100:00100000:2.0:1787829893.038713:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:5602:x1874675275684608:12345-192.168.201.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787829893.039296:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:5602:x1874675275684608:12345-192.168.201.51@tcp:503:ll_cfg_requeue.0 Request processed in 583us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829893.039305:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 274 00000100:00100000:3.0:1787829893.051347:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829893.051461:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275684736 00000100:00100000:1.0:1787829893.051477:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275684736 00000100:00100000:1.0:1787829893.051555:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 275 00000100:00100000:1.0:1787829893.051567:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:9982:x1874675275684736:12345-192.168.201.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787829893.053355:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:9982:x1874675275684736:12345-192.168.201.51@tcp:502:llog_process_th.0 Request processed in 1783us (2018us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829893.053368:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 275 00000100:00100000:1.0:1787829893.057476:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829893.057905:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275684864 00000100:00100000:2.0:1787829893.057914:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275684864 00000100:00100000:2.0:1787829893.057970:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 276 00000100:00100000:2.0:1787829893.057980:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:9982:x1874675275684864:12345-192.168.201.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787829893.058725:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:9982:x1874675275684864:12345-192.168.201.51@tcp:502:llog_process_th.0 Request processed in 743us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829893.058736:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 276 00000040:00080000:3.0:1787829893.349653:0:11648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787829893.794311:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787829893.918523:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829893.918573:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829893.918606:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829893.918712:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275684992 00000100:00100000:3.0:1787829893.918722:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275684992 00000100:00100000:3.0:1787829893.918791:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275685248 00000100:00100000:3.0:1787829893.918794:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275685248 00000100:00100000:3.0:1787829893.918821:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 108 00000100:00100000:3.0:1787829893.918860:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+5:2363:x1874675275684992:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829893.918934:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+5:2363:x1874675275684992:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 77us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829893.918942:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 108 00000100:00100000:3.0:1787829893.918959:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 109 00000100:00100000:3.0:1787829893.918965:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:902200d4-578b-4474-a651-ffe6603128fa+5:2363:x1874675275685248:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787829893.918986:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275685120 00000100:00100000:3.0:1787829893.918990:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:902200d4-578b-4474-a651-ffe6603128fa+5:2363:x1874675275685248:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 26us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829893.918990:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275685120 00000100:00100000:3.0:1787829893.918996:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 109 00000100:00100000:0.0:1787829893.919051:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 49 00000100:00100000:0.0:1787829893.919059:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+5:2363:x1874675275685120:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787829893.919089:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+5:2363:x1874675275685120:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 32us (590us total) trans 0 rc 0/0 00000100:00080000:2.0:1787829893.919137:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787829893.919142:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787829893.928821:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 49 00010000:00010000:2.0:1787829894.818975:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787829895.105783:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1787829895.842282:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829896.866555:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829897.058479:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787829897.058531:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f329e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284107392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787829897.058629:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829897.058921:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284107392 00000100:00100000:3.0:1787829897.058929:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284107392 00000100:00100000:3.0:1787829897.058996:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787829897.059005:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284107392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787829897.059070:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787829897.059119:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284107392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829897.059126:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1787829897.059200:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787829897.059228:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1787829897.059234:0:3279:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e9b47a78b40, transno 4294967300 00000100:00100000:1.0:1787829897.059258:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f329e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284107392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787829897.060196:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1874675284107776:0@lo:400:kworker.0 00000100:00100000:2.0:1787829897.060252:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829897.060282:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787829897.060288:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874675284107648:0@lo:400:kworker.0 00000100:00100000:2.0:1787829897.060313:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829897.060343:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284107776 00000100:00100000:2.0:1787829897.060348:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284107776 00000100:00100000:2.0:1787829897.060388:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284107648 00000100:00100000:2.0:1787829897.060391:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284107648 00000100:00100000:2.0:1787829897.060413:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787829897.060419:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874675284107776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829897.060461:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874675284107776:12345-0@lo:400:kworker.0 Request processed in 42us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829897.060474:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787829897.060489:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787829897.060496:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874675284107648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829897.060544:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874675284107648:12345-0@lo:400:kworker.0 Request processed in 48us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829897.060550:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:2.0:1787829897.060575:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787829897.060939:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874675284107648:0@lo:400:kworker.0 00000100:00100000:2.0:1787829897.060951:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1874675284107776:0@lo:400:kworker.0 00000100:00100000:0.0:1787829897.061049:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284107904:0@lo:400:kworker.0 00000100:00100000:0.0:1787829897.061081:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829897.061121:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787829897.061128:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284107520:0@lo:400:kworker.0 00000100:00100000:0.0:1787829897.061157:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829897.061190:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284108032:0@lo:400:kworker.0 00000100:00100000:0.0:1787829897.061215:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829897.061291:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284108032 00000100:00100000:3.0:1787829897.061296:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284108032 00000100:00100000:3.0:1787829897.061343:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787829897.061350:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284108032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829897.061394:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284108032:12345-0@lo:400:kworker.0 Request processed in 45us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829897.061401:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1787829897.061431:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b75cd0780 x1874675284108032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829897.061455:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284108032:0@lo:400:kworker.0 00000100:00080000:0.0:1787829897.061525:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787829897.061697:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284107520 00000100:00100000:1.0:1787829897.061702:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284107520 00000100:00100000:1.0:1787829897.061815:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787829897.061822:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3278:x1874675284107520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829897.061870:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3278:x1874675284107520:12345-0@lo:400:kworker.0 Request processed in 49us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829897.061877:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787829897.061969:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284107904 00000100:00100000:2.0:1787829897.061973:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284107904 00000100:00100000:2.0:1787829897.062038:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787829897.062047:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1874675284107904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829897.062090:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1874675284107904:12345-0@lo:400:kworker.0 Request processed in 47us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829897.062096:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787829897.062219:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284107520:0@lo:400:kworker.0 00000100:00100000:0.0:1787829897.062230:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284107904:0@lo:400:kworker.0 00000100:00080000:1.0:1787829897.062288:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787829897.570627:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284108160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787829897.570717:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829897.570902:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284108160 00000100:00100000:0.0:1787829897.570914:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284108160 00000100:00100000:0.0:1787829897.570971:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787829897.570981:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284108160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787829897.571035:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787829897.571538:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284108160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 556us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829897.571546:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1787829897.571652:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f4c7840 x1874675284108160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829897.571773:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284108160:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787829897.890387:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829898.914514:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829899.052455:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829899.052570:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829899.052607:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829899.052640:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829899.052710:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275685376 00000100:00100000:0.0:1787829899.052720:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275685376 00000100:00100000:0.0:1787829899.052775:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 278 00000100:00100000:0.0:1787829899.052799:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2363:x1874675275685376:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787829899.052890:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2363:x1874675275685376:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 93us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829899.052899:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 278 00000100:00100000:3.0:1787829899.053080:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275685632 00000100:00100000:3.0:1787829899.053085:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275685632 00000100:00100000:3.0:1787829899.053150:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 51 00000100:00100000:3.0:1787829899.053158:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+5:2363:x1874675275685632:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829899.053191:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+5:2363:x1874675275685632:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 34us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829899.053198:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 51 00000100:00080000:0.0:1787829899.053442:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787829899.066375:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275685504 00000100:00100000:2.0:1787829899.066389:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275685504 00000100:00100000:2.0:1787829899.066498:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275685760 00000100:00100000:2.0:1787829899.066502:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275685760 00000100:00100000:1.0:1787829899.066555:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 113 00000100:00100000:1.0:1787829899.066569:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+5:2362:x1874675275685504:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829899.066648:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+5:2362:x1874675275685504:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 83us (14202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829899.066656:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 113 00000100:00080000:0.0:1787829899.067241:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787829899.067366:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 114 00000100:00100000:2.0:1787829899.067374:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:902200d4-578b-4474-a651-ffe6603128fa+5:2362:x1874675275685760:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829899.067427:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:902200d4-578b-4474-a651-ffe6603128fa+5:2362:x1874675275685760:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 53us (14786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829899.067434:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 114 00010000:00010000:2.0:1787829899.938356:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829900.962634:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829901.986857:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787829902.178931:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3281:1874675284108288:0@lo:400:kworker.0 00000100:00100000:2.0:1787829902.179046:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829902.179116:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b44cc12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1874675284108800:0@lo:400:kworker.0 00000100:00100000:2.0:1787829902.179148:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829902.179179:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787829902.179186:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b44cc1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284108672:0@lo:400:kworker.0 00000100:00100000:2.0:1787829902.179214:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829902.179252:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284108288 00000100:00100000:2.0:1787829902.179262:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284108288 00000100:00100000:2.0:1787829902.179319:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1787829902.179330:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3281:x1874675284108288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829902.179407:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3281:x1874675284108288:12345-0@lo:400:kworker.0 Request processed in 80us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829902.179416:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1787829902.179455:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284108800 00000100:00100000:2.0:1787829902.179459:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284108800 00000100:00100000:2.0:1787829902.179496:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787829902.179502:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874675284108800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829902.179530:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874675284108800:12345-0@lo:400:kworker.0 Request processed in 29us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829902.179536:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787829902.179552:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284108672 00000100:00100000:2.0:1787829902.179555:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284108672 00000100:00100000:2.0:1787829902.179584:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787829902.179591:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284108672:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787829902.179836:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787829902.179842:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787829902.179878:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b44cc30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1874675284108544:0@lo:400:kworker.0 00000100:00100000:3.0:1787829902.180128:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3281:1874675284108288:0@lo:400:kworker.0 00000100:00100000:3.0:1787829902.180146:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b44cc12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1874675284108800:0@lo:400:kworker.0 00000100:00100000:3.0:1787829902.180200:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284108416:0@lo:400:kworker.0 00000100:00100000:0.0:1787829902.188993:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829902.189086:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b44cc03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284109056:0@lo:400:kworker.0 00000100:00100000:0.0:1787829902.189132:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829902.189185:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284109056 00000100:00100000:0.0:1787829902.189194:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284109056 00000100:00100000:0.0:1787829902.189254:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787829902.189264:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb61680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284109056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829902.189322:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb61680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284109056:12345-0@lo:400:kworker.0 Request processed in 59us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829902.189330:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787829902.189353:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284108544 00000100:00100000:0.0:1787829902.189357:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284108544 00000100:00100000:0.0:1787829902.189387:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787829902.189395:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1874675284108544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829902.189429:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1874675284108544:12345-0@lo:400:kworker.0 Request processed in 36us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829902.189435:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1787829902.189468:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787829902.189473:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787829902.189500:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b44cc03c0 x1874675284109056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829902.189514:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b44cc03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284109056:0@lo:400:kworker.0 00000100:00100000:0.0:1787829902.189528:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b44cc30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1874675284108544:0@lo:400:kworker.0 00000100:00100000:3.0:1787829902.202258:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829902.202354:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284108928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787829902.202416:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829902.202491:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284108928 00000100:00100000:1.0:1787829902.202508:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284108928 00000100:00100000:0.0:1787829902.202615:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284108416 00000100:00100000:0.0:1787829902.202636:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284108416 00000100:00100000:0.0:1787829902.202690:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787829902.202699:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284108416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829902.202781:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284108416:12345-0@lo:400:kworker.0 Request processed in 83us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829902.202789:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787829902.202964:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787829902.202980:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f328f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1874675284108928:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787829902.203062:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284108416:0@lo:400:kworker.0 00002000:00000024:1.0:1787829902.203265:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787829902.203383:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f328f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1874675284108928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 406us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829902.203391:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787829902.203498:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284108928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787829902.208920:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284108672:12345-0@lo:400:kworker.0 Request processed in 29322us (29697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829902.208933:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787829902.209248:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b44cc1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284108672:0@lo:400:kworker.0 00000100:00100000:3.0:1787829902.690840:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787829902.690884:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b44cc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284109184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787829902.690984:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829902.694497:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284109184 00000100:00100000:2.0:1787829902.694513:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284109184 00000100:00100000:2.0:1787829902.694587:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787829902.694599:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284109184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787829902.694652:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787829902.694754:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284109184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (3769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829902.694762:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1787829902.695357:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b44cc0000 x1874675284109184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829902.695392:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b44cc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284109184:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787829903.017838:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787829903.586960:0:11648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787829904.035564:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829904.159089:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829904.159418:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829904.159453:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829904.159544:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275686144 00000100:00100000:3.0:1787829904.159554:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275686144 00000100:00100000:3.0:1787829904.159616:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 54 00000100:00100000:3.0:1787829904.159626:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b44cc0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+5:2360:x1874675275686144:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829904.159709:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b44cc0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+5:2360:x1874675275686144:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 84us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829904.159717:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 54 00000100:00080000:3.0:1787829904.159763:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787829904.159981:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829904.160010:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275685888 00000100:00100000:0.0:1787829904.160053:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275685888 00000100:00100000:0.0:1787829904.160085:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 280 00000100:00100000:0.0:1787829904.160092:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2360:x1874675275685888:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787829904.160146:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2360:x1874675275685888:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 54us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829904.160153:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 280 00000100:00100000:2.0:1787829904.160827:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275686016 00000100:00100000:2.0:1787829904.160834:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275686016 00000100:00100000:2.0:1787829904.160889:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275686272 00000100:00100000:2.0:1787829904.160893:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275686272 00000100:00100000:2.0:1787829904.160919:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 118 00000100:00100000:2.0:1787829904.160926:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b44cc1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+5:2360:x1874675275686016:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829904.160968:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b44cc1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+5:2360:x1874675275686016:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 42us (1514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829904.160975:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 118 00000100:00100000:2.0:1787829904.160987:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 119 00000100:00100000:2.0:1787829904.160993:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b44cc2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:902200d4-578b-4474-a651-ffe6603128fa+5:2360:x1874675275686272:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829904.161034:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b44cc2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:902200d4-578b-4474-a651-ffe6603128fa+5:2360:x1874675275686272:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 24us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829904.161053:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 119 00000100:00080000:3.0:1787829904.161232:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787829905.059375:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829906.087260:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829907.106267:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829907.298288:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fb63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874675284109568:0@lo:400:kworker.0 00000100:00100000:0.0:1787829907.298373:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829907.298430:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fb61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284110080:0@lo:400:kworker.0 00000100:00100000:0.0:1787829907.298456:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829907.298486:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787829907.298492:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fb62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284109440:0@lo:400:kworker.0 00000100:00100000:1.0:1787829907.298904:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f329680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284109312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787829907.298978:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284109568 00000100:00100000:3.0:1787829907.298995:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284109568 00000100:00100000:3.0:1787829907.299068:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787829907.299079:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1874675284109568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829907.299243:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fb63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284109696:0@lo:400:kworker.0 00000100:00100000:1.0:1787829907.301936:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829907.302032:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fb621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284109824:0@lo:400:kworker.0 00000100:00100000:1.0:1787829907.302078:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829907.302136:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284110080 00000100:00100000:3.0:1787829907.302282:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1874675284109568:12345-0@lo:400:kworker.0 Request processed in 3201us (3905us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829907.302293:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787829907.302376:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284109312 00000100:00100000:3.0:1787829907.302380:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284109312 00000100:00100000:3.0:1787829907.302442:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787829907.302450:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b44cc3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284109312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787829907.302494:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787829907.302538:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b44cc3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284109312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829907.302558:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1787829907.302575:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787829907.302718:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284110080 00000100:00100000:1.0:1787829907.302757:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284109824 00000100:00100000:1.0:1787829907.302761:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284109824 00000100:00100000:1.0:1787829907.302780:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787829907.302786:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb60b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284110080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829907.302922:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829907.302958:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fb62580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1874675284109952:0@lo:400:kworker.0 00000100:00100000:0.0:1787829907.302999:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829907.303044:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fb63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874675284109568:0@lo:400:kworker.0 00000100:00100000:0.0:1787829907.303074:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787829907.303082:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b44cc3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284109824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829907.303112:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b44cc3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284109824:12345-0@lo:400:kworker.0 Request processed in 32us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829907.303118:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787829907.303140:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284109440 00000100:00100000:0.0:1787829907.303144:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284109440 00000100:00100000:0.0:1787829907.303170:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787829907.303176:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3279:x1874675284109440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829907.303210:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3279:x1874675284109440:12345-0@lo:400:kworker.0 Request processed in 34us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829907.303216:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787829907.303244:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284109952 00000100:00100000:0.0:1787829907.303248:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284109952 00000100:00100000:0.0:1787829907.303274:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787829907.303280:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1874675284109952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829907.303319:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1874675284109952:12345-0@lo:400:kworker.0 Request processed in 39us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829907.303325:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787829907.303355:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fb62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284109440:0@lo:400:kworker.0 00000100:00100000:0.0:1787829907.303365:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fb62580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1874675284109952:0@lo:400:kworker.0 00000100:00080000:0.0:1787829907.303403:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787829907.303406:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787829907.303514:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb60b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284110080:12345-0@lo:400:kworker.0 Request processed in 727us (5056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829907.303521:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787829907.304040:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f329680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284109312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787829907.304065:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fb621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284109824:0@lo:400:kworker.0 00010000:00080000:0.0:1787829907.305041:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7fb61a40 x1874675284110080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829907.305060:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fb61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284110080:0@lo:400:kworker.0 00000100:00100000:2.0:1787829907.305245:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829907.305349:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284109696 00000100:00100000:0.0:1787829907.305355:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284109696 00000100:00080000:3.0:1787829907.305477:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787829907.305516:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787829907.305525:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284109696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829907.305587:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284109696:12345-0@lo:400:kworker.0 Request processed in 64us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829907.305593:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787829907.308591:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fb63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284109696:0@lo:400:kworker.0 00000100:00100000:2.0:1787829907.810494:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b44cc21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284110208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787829907.810587:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829907.810886:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284110208 00000100:00100000:1.0:1787829907.810894:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284110208 00000100:00100000:1.0:1787829907.810949:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787829907.810961:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284110208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787829907.811009:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787829907.811106:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284110208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829907.811114:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1787829907.811272:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b44cc21c0 x1874675284110208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787829907.811293:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b44cc21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284110208:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787829908.130624:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829909.154754:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829909.282592:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829909.282678:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829909.282793:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275686528 00000100:00100000:2.0:1787829909.282804:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275686528 00000100:00100000:2.0:1787829909.282903:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 123 00000100:00100000:2.0:1787829909.282924:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+5:2363:x1874675275686528:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829909.283013:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+5:2363:x1874675275686528:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 101us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829909.283060:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 123 00000100:00080000:0.0:1787829909.283302:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787829909.284428:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275686400 00000100:00100000:3.0:1787829909.284438:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275686400 00000100:00100000:3.0:1787829909.284563:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 282 00000100:00100000:3.0:1787829909.284574:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2363:x1874675275686400:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829909.284645:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2363:x1874675275686400:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 74us (2066us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829909.284653:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 282 00000100:00100000:0.0:1787829909.303776:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829909.303906:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829909.304077:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275686784 00000100:00100000:1.0:1787829909.304088:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275686784 00000100:00100000:1.0:1787829909.304168:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 124 00000100:00100000:1.0:1787829909.304178:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:902200d4-578b-4474-a651-ffe6603128fa+5:2363:x1874675275686784:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829909.304261:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:902200d4-578b-4474-a651-ffe6603128fa+5:2363:x1874675275686784:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 84us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829909.304268:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 124 00000100:00080000:0.0:1787829909.305204:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787829909.306656:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275686656 00000100:00100000:2.0:1787829909.306668:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275686656 00000100:00100000:2.0:1787829909.306809:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 19 00000100:00100000:2.0:1787829909.306820:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb62580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+5:2359:x1874675275686656:12345-192.168.201.51@tcp:9:kworker.0 00000020:00000080:2.0:1787829909.306856:0:6651:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d79c9 00000100:00080000:2.0:1787829909.306874:0:6651:0:(import.c:65:import_set_state_nolock()) ffff9e9b7f4e0000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787829909.307098:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1787829909.307261:0:6651:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1787829909.307610:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb62580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+2:2359:x1874675275686656:12345-192.168.201.51@tcp:9:kworker.0 Request processed in 791us (3842us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829909.307619:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 19 00000100:00080000:0.0:1787829909.310281:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787829910.178288:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787829910.462488:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b6abf229-545c-43fd-8dee-d9adf582be48 00000020:00000080:1.0:1787829910.462498:0:6674:0:(genops.c:885:class_export_put()) final put ffff9e9b7f4e2000/b6abf229-545c-43fd-8dee-d9adf582be48 00000020:00000080:3.0:1787829910.462615:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b7f4e2000/b6abf229-545c-43fd-8dee-d9adf582be48 for lustre-OST0000 00000020:00000080:3.0:1787829910.462687:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b7f4e0000 for lustre-OST0000 00010000:00010000:2.0:1787829911.203467:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829912.232952:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829912.419383:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fb612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284110720:0@lo:400:kworker.0 00000100:00100000:0.0:1787829912.419469:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829912.419526:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787829912.419532:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fb60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284110336:0@lo:400:kworker.0 00000100:00100000:0.0:1787829912.419559:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829912.419578:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fb603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1874675284110848:0@lo:400:kworker.0 00000100:00100000:0.0:1787829912.419601:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829912.419624:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fb630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284110464:0@lo:400:kworker.0 00000100:00100000:0.0:1787829912.419660:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829912.419680:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fb63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284110976:0@lo:400:kworker.0 00000100:00100000:0.0:1787829912.419701:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829912.419719:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787829912.419724:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fb61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284110592:0@lo:400:kworker.0 00000100:00100000:0.0:1787829912.419743:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829912.419772:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284110720 00000100:00100000:0.0:1787829912.419778:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284110720 00000100:00100000:0.0:1787829912.419824:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284110976 00000100:00100000:0.0:1787829912.419828:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284110976 00000100:00100000:0.0:1787829912.419854:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787829912.419864:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284110720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829912.419936:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284110720:12345-0@lo:400:kworker.0 Request processed in 73us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829912.419944:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787829912.419959:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787829912.419965:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284110976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829912.419997:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284110976:12345-0@lo:400:kworker.0 Request processed in 32us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829912.420011:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787829912.420056:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284110336 00000100:00100000:0.0:1787829912.420060:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284110336 00000100:00100000:0.0:1787829912.420084:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787829912.420090:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3280:x1874675284110336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829912.420121:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3280:x1874675284110336:12345-0@lo:400:kworker.0 Request processed in 31us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829912.420127:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787829912.420152:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284110848 00000100:00100000:0.0:1787829912.420155:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284110848 00000100:00100000:0.0:1787829912.420177:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284110464 00000100:00100000:0.0:1787829912.420181:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284110464 00000100:00100000:0.0:1787829912.420197:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284110592 00000100:00100000:0.0:1787829912.420200:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284110592 00000100:00100000:0.0:1787829912.420213:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787829912.420220:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874675284110848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829912.420249:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874675284110848:12345-0@lo:400:kworker.0 Request processed in 30us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829912.420254:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787829912.420266:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787829912.420271:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284110464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829912.420297:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284110464:12345-0@lo:400:kworker.0 Request processed in 26us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829912.420302:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787829912.420312:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787829912.420318:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284110592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829912.420361:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284110592:12345-0@lo:400:kworker.0 Request processed in 44us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829912.420367:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:0.0:1787829912.420391:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787829912.420395:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787829912.420397:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787829912.420435:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fb61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284110592:0@lo:400:kworker.0 00000100:00100000:0.0:1787829912.420448:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fb630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284110464:0@lo:400:kworker.0 00010000:00080000:0.0:1787829912.420460:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7fb63c00 x1874675284110976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829912.420471:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fb63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284110976:0@lo:400:kworker.0 00000100:00100000:0.0:1787829912.420505:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fb60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284110336:0@lo:400:kworker.0 00000100:00100000:0.0:1787829912.420515:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fb603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1874675284110848:0@lo:400:kworker.0 00000100:00100000:0.0:1787829912.420524:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fb612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284110720:0@lo:400:kworker.0 00000100:00100000:0.0:1787829912.421128:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f32a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284111104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787829912.421165:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829912.421191:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284111104 00000100:00100000:3.0:1787829912.421196:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284111104 00000100:00100000:3.0:1787829912.421245:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787829912.421253:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284111104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787829912.421283:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787829912.421326:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284111104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829912.421333:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787829912.421741:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f32a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284111104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787829912.936322:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787829912.936345:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b44cc1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284111232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787829912.936424:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829912.936491:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284111232 00000100:00100000:1.0:1787829912.936499:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284111232 00000100:00100000:1.0:1787829912.936543:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787829912.936552:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b44cc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284111232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787829912.936589:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787829912.936633:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b44cc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284111232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829912.936640:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1787829912.936678:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b44cc1a40 x1874675284111232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829912.936697:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b44cc1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284111232:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787829913.252944:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787829913.829725:0:11648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787829914.275102:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829914.404131:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829914.404172:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829914.404216:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829914.404379:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275687168 00000100:00100000:1.0:1787829914.404391:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275687168 00000100:00100000:1.0:1787829914.404465:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275687040 00000100:00100000:1.0:1787829914.404469:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275687040 00000100:00100000:1.0:1787829914.404497:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 128 00000100:00100000:1.0:1787829914.404507:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:902200d4-578b-4474-a651-ffe6603128fa+5:2362:x1874675275687168:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829914.404585:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:902200d4-578b-4474-a651-ffe6603128fa+5:2362:x1874675275687168:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 80us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829914.404593:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 128 00000100:00100000:1.0:1787829914.404608:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 129 00000100:00100000:1.0:1787829914.404615:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+5:2362:x1874675275687040:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829914.404640:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+5:2362:x1874675275687040:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 26us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829914.404646:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 129 00000100:00100000:3.0:1787829914.405304:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275686912 00000100:00100000:3.0:1787829914.405310:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275686912 00000100:00100000:3.0:1787829914.405354:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 284 00000100:00100000:3.0:1787829914.405375:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2362:x1874675275686912:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829914.405434:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2362:x1874675275686912:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 61us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829914.405441:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 284 00000100:00080000:0.0:1787829914.406063:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787829915.298431:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787829915.889927:0:11812:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 07:25:14 (1787829914) 00010000:00010000:0.0:1787829916.326986:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829917.346426:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829917.540197:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b74cf52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284111488:0@lo:400:kworker.0 00000100:00100000:0.0:1787829917.540271:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829917.540329:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b74cf5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284112000:0@lo:400:kworker.0 00000100:00100000:0.0:1787829917.540356:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829917.540420:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787829917.540427:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b74cf43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284111616:0@lo:400:kworker.0 00000100:00100000:0.0:1787829917.540451:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829917.540493:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284112000 00000100:00100000:0.0:1787829917.540501:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284112000 00000100:00100000:0.0:1787829917.540557:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787829917.540567:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284112000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829917.540620:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284112000:12345-0@lo:400:kworker.0 Request processed in 54us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829917.540627:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1787829917.540648:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787829917.540676:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b74cf5680 x1874675284112000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787829933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829917.540689:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b74cf5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284112000:0@lo:400:kworker.0 00000100:00100000:1.0:1787829917.541113:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b74cf5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3281:1874675284111360:0@lo:400:kworker.0 00000100:00100000:1.0:1787829917.541153:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829917.541190:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b74cf4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1874675284111872:0@lo:400:kworker.0 00000100:00100000:1.0:1787829917.541215:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829917.541235:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787829917.541240:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b74cf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284111744:0@lo:400:kworker.0 00000100:00100000:1.0:1787829917.541263:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829917.541294:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284111360 00000100:00100000:1.0:1787829917.541295:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284111488 00000100:00100000:3.0:1787829917.541301:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284111360 00000100:00100000:1.0:1787829917.541302:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284111488 00000100:00100000:3.0:1787829917.541336:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787829917.541346:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3281:x1874675284111360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829917.541351:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284111616 00000100:00100000:1.0:1787829917.541357:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284111616 00000100:00100000:1.0:1787829917.541384:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284111872 00000100:00100000:1.0:1787829917.541387:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284111872 00000100:00100000:1.0:1787829917.541407:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787829917.541412:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3281:x1874675284111360:12345-0@lo:400:kworker.0 Request processed in 66us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829917.541419:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284111488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829917.541424:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787829917.541466:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284111488:12345-0@lo:400:kworker.0 Request processed in 50us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829917.541474:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787829917.541486:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787829917.541496:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284111616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829917.541508:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787829917.541525:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b44cc0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874675284111872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829917.541531:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284111616:12345-0@lo:400:kworker.0 Request processed in 36us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829917.541539:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787829917.541563:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b44cc0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874675284111872:12345-0@lo:400:kworker.0 Request processed in 40us (346us total) trans 0 rc 0/0 00000100:00080000:3.0:1787829917.541565:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787829917.541573:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787829917.541607:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b74cf5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3281:1874675284111360:0@lo:400:kworker.0 00000100:00100000:1.0:1787829917.541617:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b74cf4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1874675284111872:0@lo:400:kworker.0 00000100:00100000:0.0:1787829917.541776:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284111744 00000100:00100000:0.0:1787829917.541842:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284111744 00000100:00100000:0.0:1787829917.541947:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787829917.541957:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b44cc2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284111744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829917.542004:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b44cc2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284111744:12345-0@lo:400:kworker.0 Request processed in 50us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829917.542006:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f32b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284112128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787829917.542040:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787829917.542076:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787829917.542088:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787829917.542114:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284112128 00000100:00100000:3.0:1787829917.542118:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284112128 00000100:00100000:3.0:1787829917.542156:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787829917.542172:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284112128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787829917.542199:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787829917.542241:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284112128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829917.542256:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787829917.542301:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b74cf43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284111616:0@lo:400:kworker.0 00000100:00100000:3.0:1787829917.542315:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b74cf52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284111488:0@lo:400:kworker.0 00000100:00100000:3.0:1787829917.542353:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b74cf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284111744:0@lo:400:kworker.0 00000100:00100000:2.0:1787829917.542526:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f32b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284112128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787829917.676845:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829917.677537:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275687296 00000100:00100000:3.0:1787829917.677547:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275687296 00000100:00080000:0.0:1787829917.677689:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787829917.677740:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 32 00000100:00100000:3.0:1787829917.677750:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+5:10252:x1874675275687296:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787829917.677771:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829917.677857:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7a94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c877e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.677930:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7a9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.677945:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7a9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.677957:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7a9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787829917.685658:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787829917.685678:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787829917.685823:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7a9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.685867:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7a94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c877e expref: 7 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.685890:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7a9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c877e expref: 6 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.685899:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b478cc100) 00010000:00010000:2.0:1787829917.685902:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787829917.685984:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164e400, rc 0) 00000100:00100000:2.0:1787829917.686189:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+6:10252:x1874675275687296:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 8438us (9382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829917.686199:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 32 00000100:00100000:2.0:1787829917.701618:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829917.701756:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275687424 00000100:00100000:3.0:1787829917.701767:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275687424 00000100:00100000:3.0:1787829917.701860:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 33 00000100:00100000:3.0:1787829917.701872:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f382d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:10253:x1874675275687424:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787829917.701895:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829917.701934:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7aa2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8785 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.702009:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7aa9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.702048:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7aa9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.702060:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7aa9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.702077:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7ab0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.702084:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.702090:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.709330:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164f600/0xc03b4d103c0d7ab7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.709357:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164f600/0xc03b4d103c0d7ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.709378:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164f600/0xc03b4d103c0d7ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829917.709494:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787829917.709499:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787829917.709586:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164f600/0xc03b4d103c0d7ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.709607:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7aa9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.709614:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7aa9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.709621:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7aa9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.709628:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164fc00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829917.709632:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7aa9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.709640:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7aa9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.709654:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b478cc100) 00010000:00010000:3.0:1787829917.709658:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829917.709663:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7aa9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.709670:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7aa9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.709685:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.709692:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7ab0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.709698:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.709709:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164e200 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829917.709712:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.709719:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7ab0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.709727:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9e9b478cc500) 00010000:00010000:3.0:1787829917.709730:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829917.709733:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7ab0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.709738:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7ab0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.709780:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7aa2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8785 expref: 8 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.709794:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164f600/0xc03b4d103c0d7ab7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8785 expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829917.709801:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e9b478cc000) 00010000:00010000:3.0:1787829917.710585:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787829917.710592:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164f600, rc 0) 00000100:00100000:3.0:1787829917.710712:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f382d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+7:10253:x1874675275687424:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 8840us (9101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829917.710722:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 33 00000100:00100000:1.0:1787829917.723195:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829917.723523:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275687680 00000100:00100000:2.0:1787829917.723534:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275687680 00000100:00100000:2.0:1787829917.723600:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 34 00000100:00100000:2.0:1787829917.723612:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b44cc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+7:10253:x1874675275687680:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787829917.723635:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829917.723658:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d7abe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c878c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.723745:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7ac5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.723761:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7ac5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.723802:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7ac5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.723859:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d7acc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.723867:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d7acc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.723874:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d7acc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.726454:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e200/0xc03b4d103c0d7ad3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.726478:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e200/0xc03b4d103c0d7ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.726488:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e200/0xc03b4d103c0d7ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787829917.726502:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787829917.726718:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7ac5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.726726:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7ac5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.726733:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7ac5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.726739:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f800 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829917.726750:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7ac5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.726759:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7ac5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.726772:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e9b478cc000) 00010000:00010000:2.0:1787829917.726775:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829917.729055:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7ac5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.729073:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7ac5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.729096:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d7acc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.729102:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d7acc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.729108:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d7acc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.729114:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829917.729117:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d7acc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.729124:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d7acc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.729141:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e9b45193600) 00010000:00010000:2.0:1787829917.729144:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829917.729234:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d7acc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.729239:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d7acc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.731495:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d7abe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c878c expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.731524:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e200/0xc03b4d103c0d7ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c878c expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829917.731535:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e9b45193300) 00010000:00010000:2.0:1787829917.731538:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829917.731541:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3e200, rc 0) 00000100:00100000:2.0:1787829917.731776:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b44cc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+9:10253:x1874675275687680:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 8165us (8590us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787829917.731797:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 34 00000100:00100000:1.0:1787829917.747749:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829917.747951:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275687808 00000100:00100000:2.0:1787829917.747961:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275687808 00000100:00100000:2.0:1787829917.748094:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 35 00000100:00100000:2.0:1787829917.748106:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b44cc1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+9:10253:x1874675275687808:12345-192.168.201.51@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787829917.748354:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b44cc1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+9:10253:x1874675275687808:12345-192.168.201.51@tcp:59:lhsmtool_posix.0 Request processed in 249us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829917.748420:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 35 00000040:00080000:1.0:1787829917.923623:0:11648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787829918.050239:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787829918.050297:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b44cc21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284112256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787829918.050424:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829918.050564:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284112256 00000100:00100000:1.0:1787829918.050575:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284112256 00000100:00100000:1.0:1787829918.050643:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787829918.050653:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f32bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284112256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787829918.050691:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787829918.050773:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f32bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284112256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829918.050807:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1787829918.050856:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b44cc21c0 x1874675284112256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787829934 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787829918.050875:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b44cc21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284112256:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787829918.371321:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829919.394374:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787829919.524514:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829919.524608:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829919.524667:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275687936 00000100:00100000:3.0:1787829919.524676:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275687936 00000100:00100000:3.0:1787829919.524736:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 286 00000100:00100000:3.0:1787829919.524747:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2363:x1874675275687936:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829919.524850:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2363:x1874675275687936:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 105us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829919.524858:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 286 00000100:00100000:3.0:1787829919.525901:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829919.525940:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275688064 00000100:00100000:3.0:1787829919.525946:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275688064 00000100:00100000:3.0:1787829919.525994:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275688192 00000100:00100000:3.0:1787829919.525998:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275688192 00000100:00100000:2.0:1787829919.526866:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 133 00000100:00100000:3.0:1787829919.527075:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 134 00000100:00100000:3.0:1787829919.528834:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f32b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:902200d4-578b-4474-a651-ffe6603128fa+5:2363:x1874675275688192:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829919.528945:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f32b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:902200d4-578b-4474-a651-ffe6603128fa+5:2363:x1874675275688192:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 1860us (3048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829919.528955:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 134 00000100:00080000:3.0:1787829919.528991:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787829919.538670:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f329a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+9:2362:x1874675275688064:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829919.538821:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f329a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+9:2362:x1874675275688064:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 11943us (14314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829919.538834:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 133 00000100:00100000:3.0:1787829919.866351:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829919.867010:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275688320 00000100:00100000:0.0:1787829919.867050:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275688320 00000100:00100000:0.0:1787829919.867111:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 36 00000100:00100000:0.0:1787829919.867123:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f32a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+9:10295:x1874675275688320:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:0.0:1787829919.867143:0:10044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829919.868647:0:10044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174400/0xc03b4d103c0d7ae1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8793 expref: -99 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.868727:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174e00/0xc03b4d103c0d7ae8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.868743:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174e00/0xc03b4d103c0d7ae8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.868755:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174e00/0xc03b4d103c0d7ae8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.868787:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7aef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.868796:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7aef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.868803:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7aef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.869088:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174e00/0xc03b4d103c0d7ae8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.869096:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174e00/0xc03b4d103c0d7ae8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.869110:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174e00/0xc03b4d103c0d7ae8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.869116:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b82174e00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829919.869120:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174e00/0xc03b4d103c0d7ae8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.869129:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174e00/0xc03b4d103c0d7ae8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.869143:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b478cc100) 00010000:00010000:0.0:1787829919.869146:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787829919.869151:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174e00/0xc03b4d103c0d7ae8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.869158:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174e00/0xc03b4d103c0d7ae8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.869172:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7aef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.869179:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7aef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.869185:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7aef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.869190:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b82174000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829919.869193:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7aef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.869210:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7aef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.869219:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e9b48f25500) 00010000:00010000:0.0:1787829919.869221:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787829919.869224:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7aef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.869230:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7aef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.869269:0:10044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174400/0xc03b4d103c0d7ae1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8793 expref: 10 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.869280:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b478cc100) 00010000:00010000:0.0:1787829919.869283:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787829919.869287:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174400/0xc03b4d103c0d7ae1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8793 expref: 10 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.869296:0:10044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b82174400, rc 0) 00000100:00100000:0.0:1787829919.877446:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f32a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+9:10295:x1874675275688320:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 10314us (11092us total) trans 0 rc 301/301 00000100:00100000:0.0:1787829919.877459:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 36 00000100:00100000:1.0:1787829919.893918:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829919.894538:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275688576 00000100:00100000:0.0:1787829919.894548:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275688576 00000100:00100000:0.0:1787829919.894601:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 37 00000100:00100000:0.0:1787829919.894610:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b44cc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+9:10295:x1874675275688576:12345-192.168.201.51@tcp:36:lfs.0 00010000:00010000:0.0:1787829919.894695:0:7257:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829919.894722:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7a9b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c877e expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.894742:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b478cc100) 00010000:00010000:0.0:1787829919.894751:0:7257:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787829919.895045:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174400/0xc03b4d103c0d7af6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.895060:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174400/0xc03b4d103c0d7af6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.895071:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174400/0xc03b4d103c0d7af6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.895082:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7afd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.895090:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7afd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.895097:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7afd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787829919.896082:0:7257:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787829919.896093:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174400/0xc03b4d103c0d7af6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.896102:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174400/0xc03b4d103c0d7af6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.896109:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174400/0xc03b4d103c0d7af6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.896122:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b82174400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829919.896127:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174400/0xc03b4d103c0d7af6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.896135:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174400/0xc03b4d103c0d7af6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.896148:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b48f25500) 00010000:00010000:0.0:1787829919.896151:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787829919.896155:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174400/0xc03b4d103c0d7af6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829919.896162:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174400/0xc03b4d103c0d7af6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787829919.896180:0:7257:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b38b475 reply state 000000008ea725bb transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7afd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829919.896189:0:7257:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787829919.896302:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b44cc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+10:10295:x1874675275688576:12345-192.168.201.51@tcp:36:lfs.0 Request processed in 1690us (2392us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787829919.896312:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 37 00010000:00010000:1.0:1787829919.905059:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7afd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829919.905075:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7afd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829919.905084:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7afd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829919.905091:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b82174000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829919.905096:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7afd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829919.905106:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7afd lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829919.905124:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e9b48f25000) 00010000:00010000:1.0:1787829919.905128:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829919.905132:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7afd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829919.905140:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7afd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829920.031614:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829920.031750:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275688704 00000100:00100000:2.0:1787829920.031759:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275688704 00000100:00100000:2.0:1787829920.031837:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 38 00000100:00100000:2.0:1787829920.031848:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+9:10303:x1874675275688704:12345-192.168.201.51@tcp:101:lctl.0 00010000:00010000:2.0:1787829920.031877:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829920.032115:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7b04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c879a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.032270:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d7b0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.032285:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d7b0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.032297:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d7b0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787829920.032431:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787829920.032436:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787829920.032481:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d7b0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.032507:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7b04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c879a expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.032526:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d7b0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c879a expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.032550:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b45193f00) 00010000:00010000:2.0:1787829920.032553:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787829920.032556:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3f000, rc 0) 00000100:00100000:2.0:1787829920.032673:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+10:10303:x1874675275688704:12345-192.168.201.51@tcp:101:lctl.0 Request processed in 825us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829920.032681:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 38 00000100:00100000:1.0:1787829920.118770:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829920.120489:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275688832 00000100:00100000:0.0:1787829920.120505:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275688832 00000100:00100000:0.0:1787829920.120656:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 39 00000100:00100000:0.0:1787829920.120669:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b44cc1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+10:10309:x1874675275688832:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:0.0:1787829920.120691:0:10044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829920.120714:0:10044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174400/0xc03b4d103c0d7b12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c87a1 expref: -99 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.120814:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7b19 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.120842:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7b19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.120856:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7b19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.120871:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174e00/0xc03b4d103c0d7b20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.120878:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174e00/0xc03b4d103c0d7b20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.120886:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174e00/0xc03b4d103c0d7b20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.121000:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82175800/0xc03b4d103c0d7b27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.121009:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82175800/0xc03b4d103c0d7b27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.121038:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82175800/0xc03b4d103c0d7b27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787829920.121082:0:10044:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787829920.121085:0:10044:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787829920.121128:0:10044:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82175800/0xc03b4d103c0d7b27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.121151:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7b19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.121157:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7b19 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.121162:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7b19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.121167:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b82174000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829920.121171:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7b19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.121178:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7b19 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.121190:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b45193f00) 00010000:00010000:0.0:1787829920.121193:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787829920.121197:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7b19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.121203:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7b19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.121216:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174e00/0xc03b4d103c0d7b20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.121222:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174e00/0xc03b4d103c0d7b20 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.121227:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174e00/0xc03b4d103c0d7b20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.121236:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b82174e00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829920.121239:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174e00/0xc03b4d103c0d7b20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.121244:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174e00/0xc03b4d103c0d7b20 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.121251:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e9b48f25500) 00010000:00010000:0.0:1787829920.121254:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787829920.121326:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174e00/0xc03b4d103c0d7b20 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.121333:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174e00/0xc03b4d103c0d7b20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.121440:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174400/0xc03b4d103c0d7b12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87a1 expref: 12 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.121457:0:10044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82175800/0xc03b4d103c0d7b27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87a1 expref: 11 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.121464:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:0.0:1787829920.121466:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787829920.121469:0:10044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b82175800, rc 0) 00000100:00100000:0.0:1787829920.121613:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b44cc1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+11:10309:x1874675275688832:12345-192.168.201.51@tcp:101:bash.0 Request processed in 946us (3849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829920.121622:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 39 00000100:00100000:0.0:1787829920.136148:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829920.136595:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275689088 00000100:00100000:1.0:1787829920.136606:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275689088 00000100:00100000:1.0:1787829920.136671:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 40 00000100:00100000:1.0:1787829920.136681:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+11:10309:x1874675275689088:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:1.0:1787829920.136702:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829920.136723:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7b2e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c87a8 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.136888:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d7b35 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.136906:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d7b35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.136919:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d7b35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.136985:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7b3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.136994:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7b3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.137001:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7b3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787829920.138931:0:5805:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1787829920.139150:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d7b43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.139175:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d7b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.139186:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d7b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.139224:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d7b35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.139231:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d7b35 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.139238:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d7b35 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.139245:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feee200 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829920.139249:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d7b35 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.139273:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d7b35 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.139287:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:1.0:1787829920.139290:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829920.139295:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d7b35 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.139302:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d7b35 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787829920.139315:0:5805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e88de476 reply state 0000000060a45e15 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7b3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829920.139331:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787829920.139376:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7b2e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87a8 expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.139391:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d7b43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87a8 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.139399:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b507a7700) 00010000:00010000:1.0:1787829920.139402:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787829920.139405:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feef400, rc 0) 00000100:00100000:1.0:1787829920.139496:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+14:10309:x1874675275689088:12345-192.168.201.51@tcp:101:bash.0 Request processed in 2816us (3359us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787829920.139506:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 40 00010000:00010000:3.0:1787829920.155136:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7b3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829920.155156:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7b3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829920.155185:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7b3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829920.155191:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feefc00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829920.155196:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7b3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829920.155205:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7b3c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829920.155222:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e9b507a7100) 00010000:00010000:3.0:1787829920.155225:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829920.155230:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7b3c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829920.155237:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7b3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829920.155268:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829920.155367:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275689216 00000100:00100000:2.0:1787829920.155376:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275689216 00000100:00100000:2.0:1787829920.155423:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 20 00000100:00100000:2.0:1787829920.155431:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2359:x1874675275689216:12345-192.168.201.51@tcp:8:bash.0 00010000:00080000:2.0:1787829920.155464:0:8603:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b6abf229-545c-43fd-8dee-d9adf582be48@192.168.201.51@tcp t0 exp 0000000000000000 cur 300 last 0 00000020:00000080:2.0:1787829920.155492:0:8603:0:(genops.c:1385:class_connect()) connect: client b6abf229-545c-43fd-8dee-d9adf582be48, cookie 0xc03b4d103c0d7b51 00002000:00100000:2.0:1787829920.155503:0:8603:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b6abf229-545c-43fd-8dee-d9adf582be48/ffff9e9b52e37000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787829920.155527:0:8603:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:2.0:1787829920.155751:0:8603:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787829920.155793:0:8603:0:(import.c:65:import_set_state_nolock()) ffff9e9b52e32800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787829920.155864:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+6:2359:x1874675275689216:12345-192.168.201.51@tcp:8:bash.0 Request processed in 431us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829920.155872:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 20 00000100:00100000:1.0:1787829920.159720:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829920.169226:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275689344 00000100:00100000:0.0:1787829920.169241:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275689344 00000100:00100000:0.0:1787829920.169335:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 21 00000100:00100000:0.0:1787829920.169348:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b44cc30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:0:x1874675275689344:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:0.0:1787829920.169368:0:6652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829920.169392:0:6652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af63cf5c/0xc03b4d103c0d7b58 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c87af expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787829920.169419:0:6652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787829920.169437:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=300s v=(0 0) 00010000:00010000:0.0:1787829920.169442:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787829920.169452:0:6652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af63cf5c/0xc03b4d103c0d7b58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87af expref: 7 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.169472:0:6652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000af63cf5c/0xc03b4d103c0d7b58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87af expref: 7 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.169485:0:6652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b82174400, rc 0) 00000100:00100000:0.0:1787829920.169555:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b44cc30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+7:0:x1874675275689344:12345-192.168.201.51@tcp:101:bash.0 Request processed in 210us (9846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829920.169562:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 21 00000100:00080000:3.0:1787829920.170004:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787829920.173183:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829920.173406:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275689472 00000100:00100000:2.0:1787829920.173416:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275689472 00000100:00100000:2.0:1787829920.173477:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 22 00000100:00100000:2.0:1787829920.173488:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b44cc03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+7:10309:x1874675275689472:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:2.0:1787829920.173505:0:8603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829920.173542:0:8603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d7b5f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c87b6 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.173573:0:8603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000af63cf5c/0xc03b4d103c0d7b58 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87af expref: 8 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.173582:0:8603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787829920.173587:0:8603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787829920.173592:0:8603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d7b5f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87b6 expref: 8 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.173626:0:8603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000af63cf5c/0xc03b4d103c0d7b58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c87af expref: 8 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.173639:0:8603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000af63cf5c/0xc03b4d103c0d7b58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c87af expref: 8 pid: 6652 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829920.173982:0:8603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f381680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8603:1874675284112384:192.168.201.51@tcp:104: 00000100:00100000:2.0:1787829920.174894:0:8603:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b601e0240 going to sleep for 11 seconds 00000100:00100000:1.0:1787829920.182471:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829920.182559:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275689600 00000100:00100000:3.0:1787829920.182570:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275689600 00010000:00010000:3.0:1787829920.182612:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000af63cf5c/0xc03b4d103c0d7b58 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c87af expref: 9 pid: 6652 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829920.182659:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 35 00000100:00100000:3.0:1787829920.182669:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b44cc12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+9:2363:x1874675275689600:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787829920.182683:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829920.182705:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000af63cf5c/0xc03b4d103c0d7b58 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c87af expref: 9 pid: 6652 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829920.182732:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000af63cf5c/0xc03b4d103c0d7b58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c87af expref: 9 pid: 6652 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829920.182769:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787829920.182774:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787829920.182783:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d7b5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87b6 expref: 9 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829920.182795:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d7b5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87b6 expref: 9 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829920.182832:0:5790:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d7b5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87b6 expref: 9 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829920.182847:0:5790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f32a1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5790:1874675284112512:192.168.201.51@tcp:105: 00000100:00100000:3.0:1787829920.182932:0:5790:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b81e32300 going to sleep for 11 seconds 00010000:00010000:2.0:1787829920.185429:0:8603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af63cf5c/0xc03b4d103c0d7b58 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c87af expref: 9 pid: 6652 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829920.185454:0:8603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f381680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8603:1874675284112384:192.168.201.51@tcp:104: 00010000:00010000:2.0:1787829920.185483:0:8603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d7b5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c87b6 expref: 8 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.185522:0:8603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3ee00, rc 0) 00000100:00100000:2.0:1787829920.185594:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b44cc03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+8:10309:x1874675275689472:12345-192.168.201.51@tcp:101:bash.0 Request processed in 12107us (12420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829920.185604:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 22 00000100:00100000:3.0:1787829920.186436:0:5790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f32a1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5790:1874675284112512:192.168.201.51@tcp:105: 00010000:00010000:3.0:1787829920.186452:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787829920.186493:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b44cc12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+7:2363:x1874675275689600:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 3826us (4032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829920.186503:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 35 00000100:00100000:0.0:1787829920.195375:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829920.195461:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275689856 00000100:00100000:2.0:1787829920.195472:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275689856 00000100:00100000:2.0:1787829920.195534:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 6 00000100:00100000:2.0:1787829920.195544:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+13:10309:x1874675275689856:12345-192.168.201.51@tcp:35:bash.0 00000100:00100000:2.0:1787829920.195916:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+14:10309:x1874675275689856:12345-192.168.201.51@tcp:35:bash.0 Request processed in 371us (548us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787829920.195924:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 6 00000100:00100000:2.0:1787829920.305731:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829920.305941:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275690112 00000100:00100000:3.0:1787829920.305951:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275690112 00000100:00100000:3.0:1787829920.306011:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 41 00000100:00100000:3.0:1787829920.306057:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f381680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+14:10319:x1874675275690112:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:3.0:1787829920.306097:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829920.306119:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7b66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c87bd expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829920.306227:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787829920.306363:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7b66 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87bd expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829920.306378:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b45193f00) 00010000:00010000:3.0:1787829920.306381:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787829920.306386:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7b66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87bd expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829920.306402:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164ec00, rc 0) 00000100:00100000:3.0:1787829920.306456:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f381680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+15:10319:x1874675275690112:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 402us (735us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1787829920.306464:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 41 00000100:00100000:0.0:1787829920.312692:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829920.312886:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275690368 00000100:00100000:2.0:1787829920.312897:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275690368 00000100:00100000:2.0:1787829920.313012:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 7 00000100:00100000:2.0:1787829920.313065:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+15:10319:x1874675275690368:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:2.0:1787829920.313342:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+16:10319:x1874675275690368:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 279us (657us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787829920.313350:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 7 00010000:00010000:2.0:1787829920.419398:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829920.470906:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829920.471225:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275690496 00000100:00100000:0.0:1787829920.471235:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275690496 00000100:00100000:0.0:1787829920.471298:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 42 00000100:00100000:0.0:1787829920.471326:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b44cc21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+16:10325:x1874675275690496:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:0.0:1787829920.471352:0:10044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829920.471375:0:10044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7b74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c87c4 expref: -99 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.471445:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174e00/0xc03b4d103c0d7b7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.471459:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174e00/0xc03b4d103c0d7b7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.471471:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174e00/0xc03b4d103c0d7b7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787829920.471537:0:10044:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787829920.471541:0:10044:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787829920.471566:0:10044:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174e00/0xc03b4d103c0d7b7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.471594:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7b74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87c4 expref: 18 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.471615:0:10044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174e00/0xc03b4d103c0d7b7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87c4 expref: 17 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.471623:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:0.0:1787829920.471626:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787829920.471630:0:10044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b82174e00, rc 0) 00000100:00100000:0.0:1787829920.471701:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b44cc21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+17:10325:x1874675275690496:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 378us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829920.471718:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 42 00000100:00100000:3.0:1787829920.482674:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829920.482858:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275690752 00000100:00100000:1.0:1787829920.482867:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275690752 00000100:00100000:1.0:1787829920.483005:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 43 00000100:00100000:1.0:1787829920.483048:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f32a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+17:10325:x1874675275690752:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:1.0:1787829920.483069:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829920.483091:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7b82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c87cb expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.483197:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d7b89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.483228:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d7b89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.483239:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d7b89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787829920.483253:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787829920.483732:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7b82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87cb expref: 20 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.483752:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d7b89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87cb expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.483771:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b507a7700) 00010000:00010000:1.0:1787829920.483774:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787829920.483778:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feee800, rc 0) 00000100:00100000:1.0:1787829920.483981:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f32a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+19:10325:x1874675275690752:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 965us (1319us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787829920.483990:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 43 00000100:00100000:1.0:1787829920.493405:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829920.494061:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275690880 00000100:00100000:3.0:1787829920.494073:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275690880 00000100:00100000:3.0:1787829920.494146:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 2 00000100:00100000:3.0:1787829920.494158:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52386d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6abf229-545c-43fd-8dee-d9adf582be48+19:2361:x1874675275690880:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787829920.494175:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829920.494203:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d7b89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87cb expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829920.494222:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b507a7700) 00010000:00010000:3.0:1787829920.494236:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787829920.494547:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52386d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6abf229-545c-43fd-8dee-d9adf582be48+18:2361:x1874675275690880:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 390us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829920.494555:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 2 00000100:00100000:0.0:1787829920.496453:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829920.496566:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275691136 00000100:00100000:3.0:1787829920.496574:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275691136 00000100:00100000:3.0:1787829920.496626:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 44 00000100:00100000:3.0:1787829920.496635:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+18:10325:x1874675275691136:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:3.0:1787829920.496659:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829920.496677:0:7257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7b97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c87d2 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829920.496786:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7b9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829920.496802:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7b9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829920.496814:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7b9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829920.496827:0:7257:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787829920.498125:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7b97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87d2 expref: 21 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829920.498148:0:7257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7b9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87d2 expref: 20 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829920.498157:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b507a7700) 00010000:00010000:3.0:1787829920.498169:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787829920.498173:0:7257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164e200, rc 0) 00000100:00100000:3.0:1787829920.498314:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+20:10325:x1874675275691136:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 1679us (1866us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787829920.498322:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 44 00000100:00100000:2.0:1787829920.511325:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829920.511578:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275691264 00000100:00100000:0.0:1787829920.511588:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275691264 00000100:00100000:0.0:1787829920.511648:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 23 00000100:00100000:0.0:1787829920.511658:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f382940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+7:2363:x1874675275691264:12345-192.168.201.51@tcp:1:lfs.0 00010000:00010000:0.0:1787829920.511701:0:6652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bf69d1d/0xc03b4d103c0d7bac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.511721:0:6652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d7b5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c87b6 expref: 7 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.511731:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787829920.511735:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787829920.511741:0:6652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bf69d1d/0xc03b4d103c0d7bac lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.511787:0:6652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d7b5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.51@tcp remote: 0x53172783628c87b6 expref: 7 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.511802:0:6652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d7b5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c87b6 expref: 7 pid: 8603 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829920.511816:0:6652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b74cf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6652:1874675284112640:192.168.201.51@tcp:104: 00000100:00100000:0.0:1787829920.511977:0:6652:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47a4cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787829920.518775:0:6652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b74cf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6652:1874675284112640:192.168.201.51@tcp:104: 00010000:00010000:0.0:1787829920.518804:0:6652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001bf69d1d/0xc03b4d103c0d7bac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829920.519194:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829920.519547:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275691392 00000100:00100000:3.0:1787829920.519554:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275691392 00002000:00100000:3.0:1787829920.519605:0:6655:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9e9b7f381a40 x1874675275691392/t0(0) o4->b6abf229-545c-43fd-8dee-d9adf582be48@192.168.201.51@tcp:501/0 lens 504/0 e 0 to 0 dl 1787829931 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787829920.519616:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e9b7f381a40 with x1874675275691392 ext(0->12) 00010000:00010000:3.0:1787829920.519623:0:6655:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d7b5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c87b6 expref: 8 pid: 8603 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829920.519638:0:6655:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d7b5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c87b6 expref: 8 pid: 8603 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787829920.519646:0:6655:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e9b7f381a40 00000100:00100000:3.0:1787829920.519675:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 0 00000100:00100000:3.0:1787829920.519684:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f381a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b6abf229-545c-43fd-8dee-d9adf582be48+8:2362:x1874675275691392:12345-192.168.201.51@tcp:4:lfs.0 00000001:00100000:2.0:1787829920.581543:0:7602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b6abf229-545c-43fd-8dee-d9adf582be48 00000100:00100000:1.0:1787829920.582236:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f381a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b6abf229-545c-43fd-8dee-d9adf582be48+9:2362:x1874675275691392:12345-192.168.201.51@tcp:4:lfs.0 Request processed in 62545us (63036us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787829920.582252:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 0 00002000:00100000:1.0:1787829920.582265:0:6655:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9e9b7f381a40 x1874675275691392/t4294967299(0) o4->b6abf229-545c-43fd-8dee-d9adf582be48@192.168.201.51@tcp:501/0 lens 504/448 e 0 to 0 dl 1787829931 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787829920.582275:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e9b7f381a40 with x1874675275691392 ext(0->12) 00010000:00010000:1.0:1787829920.582306:0:6655:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d7b5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c87b6 expref: 9 pid: 8603 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.582324:0:6655:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d7b5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c87b6 expref: 9 pid: 8603 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787829920.582331:0:6655:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e9b7f381a40 00000100:00100000:1.0:1787829920.589470:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829920.589578:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275691520 00000100:00100000:0.0:1787829920.589587:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275691520 00010000:00010000:0.0:1787829920.589628:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d7b5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c87b6 expref: 9 pid: 8603 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829920.589676:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 36 00000100:00100000:0.0:1787829920.589686:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52384780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+9:2360:x1874675275691520:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787829920.589702:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787829920.589721:0:8409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787829920.589724:0:8409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787829920 00002000:00010000:0.0:1787829920.589726:0:8409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787829921 00002000:00010000:0.0:1787829920.589728:0:8409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787829920 00010000:00010000:0.0:1787829920.589734:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d7b5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c87b6 expref: 9 pid: 8603 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.589748:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d7b5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c87b6 expref: 9 pid: 8603 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.589781:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d7b5f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c87b6 expref: 9 pid: 8603 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.589797:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787829920.589816:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787829920.589822:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001bf69d1d/0xc03b4d103c0d7bac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.589831:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bf69d1d/0xc03b4d103c0d7bac lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.589866:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829920.589932:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52384780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+8:2360:x1874675275691520:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 246us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829920.589940:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 36 00010000:00010000:1.0:1787829920.590182:0:6652:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001bf69d1d/0xc03b4d103c0d7bac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.590202:0:6652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bf69d1d/0xc03b4d103c0d7bac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.590226:0:6652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bf69d1d/0xc03b4d103c0d7bac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.590234:0:6652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bf69d1d/0xc03b4d103c0d7bac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.590241:0:6652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bf69d1d/0xc03b4d103c0d7bac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.590247:0:6652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b82174000 already unused, calling callback (ffffffffc1651420) 00010000:00010000:1.0:1787829920.590251:0:6652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bf69d1d/0xc03b4d103c0d7bac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.590272:0:6652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bf69d1d/0xc03b4d103c0d7bac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.590286:0:6652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bf69d1d/0xc03b4d103c0d7bac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.590304:0:6652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bf69d1d/0xc03b4d103c0d7bac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829920.590357:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f382940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+7:2363:x1874675275691264:12345-192.168.201.51@tcp:1:lfs.0 Request processed in 78700us (79042us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829920.590366:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 23 00000100:00100000:2.0:1787829920.596288:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829920.596395:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275691776 00000100:00100000:1.0:1787829920.596404:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275691776 00000100:00100000:1.0:1787829920.596465:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 8 00000100:00100000:1.0:1787829920.596475:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f383480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+20:10325:x1874675275691776:12345-192.168.201.51@tcp:35:lfs.0 00000004:00010000:1.0:1787829920.596540:0:5808:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7b9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87d2 expref: 20 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787829920.596849:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1787829920.596907:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1787829920.597571:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1787829920.597629:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7bb3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.597644:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d7b43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87a8 expref: 24 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.597659:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7bb3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.597693:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d7b43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c87a8 expref: 24 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.597707:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d7b43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c87a8 expref: 24 pid: 5805 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829920.597721:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b523870c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5808:1874675284112768:192.168.201.51@tcp:104: 00000100:00100000:1.0:1787829920.597825:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4561f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787829920.603532:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b523870c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5808:1874675284112768:192.168.201.51@tcp:104: 00010000:00010000:1.0:1787829920.603561:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7bb3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829920.609281:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829920.609406:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275691904 00000100:00100000:0.0:1787829920.609415:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275691904 00010000:00010000:0.0:1787829920.609455:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d7b43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c87a8 expref: 25 pid: 5805 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829920.609488:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 37 00000100:00100000:0.0:1787829920.609497:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f383c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+25:2363:x1874675275691904:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787829920.609511:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829920.609517:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d7b43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c87a8 expref: 25 pid: 5805 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.609531:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d7b43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c87a8 expref: 25 pid: 5805 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.609553:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d7b43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c87a8 expref: 25 pid: 5805 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.609582:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b507a7700) 00010000:00010000:0.0:1787829920.609587:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7bb3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.609596:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7bb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.609604:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7bb3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.609634:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829920.609693:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f383c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+24:2363:x1874675275691904:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 197us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829920.609700:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 37 00010000:00010000:1.0:1787829920.609838:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7bb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.609847:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7bb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787829920.609964:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1787829920.610184:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1787829920.610285:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b523870c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1874675284112896:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787829920.610489:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829920.610519:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4561f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787829920.610602:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284112896 00000100:00100000:0.0:1787829920.610608:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284112896 00000100:00100000:0.0:1787829920.610644:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787829920.610663:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52385e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5808:x1874675284112896:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787829920.610742:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52385e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5808:x1874675284112896:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 92us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829920.610749:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787829920.610777:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787829920.610808:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b523870c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1874675284112896:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787829920.611914:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1787829920.611994:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b74cf4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1874675284113024:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787829920.612193:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829920.612225:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47a4c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787829920.612242:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284113024 00000100:00100000:0.0:1787829920.612248:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284113024 00000100:00100000:0.0:1787829920.612281:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787829920.612288:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5808:x1874675284113024:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787829920.612698:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5808:x1874675284113024:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 410us (505us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787829920.612706:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787829920.612749:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b74cf4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1874675284113024:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787829920.612808:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1787829920.612844:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7bb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.612855:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7bb3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.612863:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7bb3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.612869:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feeec00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829920.612873:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7bb3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.612882:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7bb3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.612898:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b507a7700) 00010000:00010000:0.0:1787829920.612901:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787829920.612905:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7bb3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.612922:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7bb3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787829920.613118:0:5808:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787829920.613351:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787829920.613363:0:5808:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 300514344772ns, next at 301514342628ns, rc = 0 00000001:00080000:0.0:1787829920.613369:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1787829920.613400:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b507a7700) 00010000:00010000:0.0:1787829920.613403:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787829920.613411:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7b9e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87d2 expref: 28 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829920.613503:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f383480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+27:10325:x1874675275691776:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 17029us (17226us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1787829920.613510:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 8 00000020:00080000:0.0:1787829920.613513:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787829920.629081:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829920.629115:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275692032 00000100:00100000:2.0:1787829920.629124:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275692032 00000100:00100000:2.0:1787829920.629180:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 45 00000100:00100000:2.0:1787829920.629191:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f380b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+27:10325:x1874675275692032:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:2.0:1787829920.629216:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829920.629240:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fe00/0xc03b4d103c0d7bba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c87d9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.629306:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fe00/0xc03b4d103c0d7bba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87d9 expref: 28 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.629321:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fe00/0xc03b4d103c0d7bba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87d9 expref: 28 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.629342:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b45193600) 00010000:00010000:2.0:1787829920.630438:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787829920.630444:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3fe00, rc 0) 00000100:00100000:2.0:1787829920.631330:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f380b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+28:10325:x1874675275692032:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 2133us (2251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829920.631341:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 45 00000100:00100000:3.0:1787829920.640557:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829920.640665:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275692288 00000100:00100000:1.0:1787829920.640685:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275692288 00000100:00100000:1.0:1787829920.640741:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 9 00000100:00100000:1.0:1787829920.640751:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b50362c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+28:10325:x1874675275692288:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:1.0:1787829920.641128:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b50362c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+29:10325:x1874675275692288:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 377us (580us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1787829920.641136:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 9 00000001:00080000:3.0:1787829920.692804:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967325 is committed 00000004:00080000:3.0:1787829920.692820:0:5827:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1787829920.692853:0:5827:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e9b47a4c600 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1787829920.692858:0:5827:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e9b7488b800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e9b47a4c180 00000020:00080000:3.0:1787829920.692861:0:5827:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e9b7488be00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e9b52e6d800 00000020:00080000:0.0:1787829920.693109:0:5838:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1787829920.693215:0:5838:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1787829920.693226:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787829920.693248:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fb612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284113152:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787829920.693338:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829920.693543:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284113152 00000100:00100000:2.0:1787829920.693551:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284113152 00000100:00100000:2.0:1787829920.693611:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787829920.693621:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3280:x1874675284113152:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787829920.693648:0:6650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1787829920.693687:0:6650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a901ea0, atime: 0x6a901ea1, ctime: 0x6a901ea0, blocks: 0x1 00010000:00010000:2.0:1787829920.693694:0:6650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009863dc01/0xc03b4d103c0d7bc1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.693710:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=300s v=(0 0) 00010000:00010000:2.0:1787829920.693714:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787829920.693720:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009863dc01/0xc03b4d103c0d7bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.693735:0:6650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009863dc01/0xc03b4d103c0d7bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.693744:0:6650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009863dc01/0xc03b4d103c0d7bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.693761:0:6650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009863dc01/0xc03b4d103c0d7bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.693789:0:6650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787829920.693826:0:11133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787829920.693835:0:11133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009863dc01/0xc03b4d103c0d7bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.693844:0:11133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3e600 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787829920.693848:0:11133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009863dc01/0xc03b4d103c0d7bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.693865:0:11133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009863dc01/0xc03b4d103c0d7bc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.693881:0:11133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009863dc01/0xc03b4d103c0d7bc1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.693888:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009863dc01/0xc03b4d103c0d7bc1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.693908:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829920.693911:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829920.693913:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829920.694480:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3280:x1874675284113152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 858us (1139us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787829920.694489:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:2.0:1787829920.695900:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e9b7fb612c0/2, rc 0, transno 4294967301 00000100:00100000:2.0:1787829920.695912:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fb612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284113152:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787829920.772895:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829920.773001:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275692544 00000100:00100000:1.0:1787829920.773012:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275692544 00000100:00100000:1.0:1787829920.773102:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 46 00000100:00100000:1.0:1787829920.773111:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f32b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+12:10335:x1874675275692544:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:1.0:1787829920.773135:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829920.773157:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d7bc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c87e0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787829920.773418:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787829920.773594:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d7bc8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87e0 expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.773609:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b45193f00) 00010000:00010000:1.0:1787829920.773611:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787829920.773617:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d7bc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87e0 expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829920.773630:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feee000, rc 0) 00000100:00100000:1.0:1787829920.773716:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f32b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+13:10335:x1874675275692544:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 605us (831us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1787829920.773723:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 46 00000100:00100000:3.0:1787829920.785974:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829920.786089:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275692672 00000100:00100000:0.0:1787829920.786100:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275692672 00000100:00100000:0.0:1787829920.786170:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 47 00000100:00100000:0.0:1787829920.786250:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f329680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+13:10335:x1874675275692672:12345-192.168.201.51@tcp:34:lfs.0 00010000:00010000:0.0:1787829920.786331:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174400/0xc03b4d103c0d7bd6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.786349:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174400/0xc03b4d103c0d7bd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.786361:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174400/0xc03b4d103c0d7bd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.786394:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7bdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.786403:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7bdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.786409:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7bdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.787498:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7be4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.787510:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7be4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.787518:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7be4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787829920.787564:0:7257:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7be4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.787577:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174400/0xc03b4d103c0d7bd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.787583:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174400/0xc03b4d103c0d7bd6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.787591:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174400/0xc03b4d103c0d7bd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.787597:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b82174400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829920.787602:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174400/0xc03b4d103c0d7bd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.787617:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174400/0xc03b4d103c0d7bd6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.787630:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:0.0:1787829920.787633:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787829920.787638:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174400/0xc03b4d103c0d7bd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.787644:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174400/0xc03b4d103c0d7bd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.787674:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7bdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.787680:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7bdd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.787685:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7bdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.787691:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b82174000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829920.787694:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7bdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.787699:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7bdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.787707:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e9b48f25000) 00010000:00010000:0.0:1787829920.787709:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787829920.787712:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7bdd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.787727:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174000/0xc03b4d103c0d7bdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.787744:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7be4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.787760:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7be4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.787767:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7be4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.787771:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7f600 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829920.787774:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7be4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.787780:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7be4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.787787:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b45193600) 00010000:00010000:0.0:1787829920.787789:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787829920.787792:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7be4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.787798:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7be4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829920.790440:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f329680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+13:10335:x1874675275692672:12345-192.168.201.51@tcp:34:lfs.0 Request processed in 4247us (4462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829920.790456:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 47 00000100:00100000:2.0:1787829920.797309:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829920.797811:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275692928 00000100:00100000:1.0:1787829920.797822:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275692928 00000100:00100000:1.0:1787829920.797890:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 10 00000100:00100000:1.0:1787829920.797900:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+13:10335:x1874675275692928:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:1.0:1787829920.798401:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+14:10335:x1874675275692928:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 500us (1099us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1787829920.798410:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 10 00000100:00100000:3.0:1787829920.858402:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829920.858514:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275693184 00000100:00100000:2.0:1787829920.858524:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275693184 00000100:00100000:2.0:1787829920.858587:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 48 00000100:00100000:2.0:1787829920.858598:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f32a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+14:10338:x1874675275693184:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:2.0:1787829920.858621:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829920.858660:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7beb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c87e7 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.858736:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7bf2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.858763:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7bf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.858776:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7bf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.858790:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7bf9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.858797:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.858803:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.859231:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d7c00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.859240:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d7c00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.859248:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d7c00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787829920.859258:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787829920.859352:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7bf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.859370:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7bf2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.859377:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7bf2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.859384:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3ea00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829920.859389:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7bf2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.859397:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7bf2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.859410:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:2.0:1787829920.859413:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829920.859417:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7bf2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.859422:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7bf2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.859434:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.859440:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7bf9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.859446:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7bf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.859451:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829920.859459:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7bf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.859466:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7bf9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.859474:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e9b45193d00) 00010000:00010000:2.0:1787829920.859476:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829920.859480:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7bf9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.859485:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7bf9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.859529:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7beb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87e7 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.859543:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d7c00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87e7 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829920.859565:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b45193600) 00010000:00010000:2.0:1787829920.859567:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787829920.859570:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3ee00, rc 0) 00000100:00100000:2.0:1787829920.859639:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f32a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+16:10338:x1874675275693184:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 1043us (1246us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787829920.859648:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 48 00000100:00100000:3.0:1787829920.863978:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829920.864194:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275693312 00000100:00100000:0.0:1787829920.864205:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275693312 00000100:00100000:0.0:1787829920.864260:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 49 00000100:00100000:0.0:1787829920.864270:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f329e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+16:10338:x1874675275693312:12345-192.168.201.51@tcp:54:lfs.0 00010000:00010000:0.0:1787829920.864352:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7c0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.864369:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.864379:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.864405:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.864413:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7c0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.864419:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7c0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.864425:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7fa00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829920.864429:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7c0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.864436:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7c0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.864446:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b45193600) 00010000:00010000:0.0:1787829920.864448:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787829920.864467:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7c0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829920.864473:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7c0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829920.864551:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f329e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+16:10338:x1874675275693312:12345-192.168.201.51@tcp:54:lfs.0 Request processed in 281us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829920.864558:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 49 00000100:00100000:0.0:1787829920.873449:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829920.878663:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275693568 00000100:00100000:1.0:1787829920.878680:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275693568 00000100:00100000:1.0:1787829920.878788:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 11 00000100:00100000:1.0:1787829920.878799:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+16:10338:x1874675275693568:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:1.0:1787829920.879093:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+17:10338:x1874675275693568:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 295us (5652us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1787829920.879101:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 11 00000100:00100000:3.0:1787829921.198615:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829921.199010:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275693824 00000100:00100000:0.0:1787829921.199051:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275693824 00000100:00100000:0.0:1787829921.199128:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 50 00000100:00100000:0.0:1787829921.199148:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f32b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+17:10369:x1874675275693824:12345-192.168.201.51@tcp:101:cat.0 00000100:00080000:3.0:1787829921.199280:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787829921.199591:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829921.199616:0:7257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7c15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c87ee expref: -99 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829921.199723:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d7c1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829921.199737:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d7c1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829921.199760:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d7c1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787829921.199772:0:7257:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787829921.200009:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7c15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87ee expref: 20 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829921.200072:0:7257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d7c1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87ee expref: 19 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829921.200081:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b45193600) 00010000:00010000:0.0:1787829921.200084:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787829921.200087:0:7257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7fa7e400, rc 0) 00000100:00100000:0.0:1787829921.200164:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f32b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+19:10369:x1874675275693824:12345-192.168.201.51@tcp:101:cat.0 Request processed in 1027us (1564us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1787829921.200503:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 50 00000100:00100000:3.0:1787829921.205124:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829921.205169:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829921.205352:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275694208 00000100:00100000:1.0:1787829921.205361:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275694208 00000100:00100000:1.0:1787829921.205417:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 12 00000100:00100000:1.0:1787829921.205524:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f328780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+19:10369:x1874675275694208:12345-192.168.201.51@tcp:35:cat.0 00000100:00100000:0.0:1787829921.205956:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275693952 00000100:00100000:0.0:1787829921.205962:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275693952 00000100:00100000:1.0:1787829921.205996:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f328780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+21:10369:x1874675275694208:12345-192.168.201.51@tcp:35:cat.0 Request processed in 569us (823us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1787829921.206005:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 12 00000100:00100000:0.0:1787829921.206009:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 3 00000100:00100000:0.0:1787829921.206039:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b51a05450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+21:2363:x1874675275693952:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787829921.206051:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829921.206077:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d7c1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87ee expref: 20 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829921.206094:0:8409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b45193600) 00010000:00010000:0.0:1787829921.206099:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829921.206121:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b51a05450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+19:2363:x1874675275693952:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 104us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829921.206127:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 3 00000100:00100000:1.0:1787829921.274166:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829921.274225:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275694464 00000100:00100000:3.0:1787829921.274234:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275694464 00000100:00100000:3.0:1787829921.274295:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 51 00000100:00100000:3.0:1787829921.274305:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b523852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+19:10375:x1874675275694464:12345-192.168.201.51@tcp:101:dd.0 00010000:00010000:3.0:1787829921.274330:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829921.274333:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787829921.274361:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82174e00/0xc03b4d103c0d7b7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87c4 expref: 19 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.274382:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:3.0:1787829921.274386:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787829921.274400:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7c2a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c87f5 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.274618:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c31 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.274632:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d7c00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87e7 expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.274641:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c31 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.274691:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d7c00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c87e7 expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.274704:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d7c00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c87e7 expref: 19 pid: 5806 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829921.274718:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4d6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1874675284113280:192.168.201.51@tcp:104: 00000100:00100000:3.0:1787829921.274838:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b81e32b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787829921.285671:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829921.285798:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275694592 00000100:00100000:1.0:1787829921.285808:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275694592 00010000:00010000:1.0:1787829921.285851:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d7c00 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c87e7 expref: 20 pid: 5806 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829921.285912:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 38 00000100:00100000:1.0:1787829921.285922:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb63c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+20:2363:x1874675275694592:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787829921.285938:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829921.285946:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d7c00 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c87e7 expref: 20 pid: 5806 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829921.285958:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d7c00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c87e7 expref: 20 pid: 5806 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829921.285981:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b45193600) 00010000:00010000:1.0:1787829921.285986:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c31 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829921.285995:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829921.286002:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c31 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829921.286051:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829921.286113:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb63c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+20:2363:x1874675275694592:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 182us (443us total) trans 0 rc 0/0 00010000:00010000:3.0:1787829921.286117:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d7c00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c87e7 expref: 20 pid: 5806 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829921.286121:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 38 00000100:00100000:3.0:1787829921.286132:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4d6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1874675284113280:192.168.201.51@tcp:104: 00010000:00010000:3.0:1787829921.286151:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.286161:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.286166:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829921.286183:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787829921.287480:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7c2a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87f5 expref: 20 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.287503:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87f5 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.287527:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b45193600) 00010000:00010000:3.0:1787829921.287530:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787829921.287534:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164fc00, rc 0) 00000100:00100000:3.0:1787829921.287590:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b523852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+19:10375:x1874675275694464:12345-192.168.201.51@tcp:101:dd.0 Request processed in 13286us (13431us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787829921.287597:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 51 00000100:00100000:0.0:1787829921.290288:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829921.290411:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275694848 00000100:00100000:2.0:1787829921.290419:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275694848 00000100:00100000:2.0:1787829921.290472:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 52 00000100:00100000:2.0:1787829921.290484:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+19:10375:x1874675275694848:12345-192.168.201.51@tcp:36:dd.0 00010000:00010000:2.0:1787829921.290720:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7c3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.290733:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7c3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.290752:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7c3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787829921.290809:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1787829921.290835:0:5804:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ebd47f1 reply state 00000000617879fa transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7c3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829921.290843:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787829921.290940:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+22:10375:x1874675275694848:12345-192.168.201.51@tcp:36:dd.0 Request processed in 457us (660us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1787829921.290948:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 52 00000020:00080000:2.0:1787829921.290953:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787829921.293057:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7c3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.293072:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7c3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.293078:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7c3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.293084:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f200 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829921.293088:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7c3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.293095:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7c3f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.293272:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b45193600) 00010000:00010000:2.0:1787829921.293275:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829921.293282:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7c3f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.293288:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7c3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829921.442385:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829921.634458:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829921.635418:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275694976 00000100:00100000:2.0:1787829921.635430:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275694976 00000100:00100000:2.0:1787829921.635492:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 53 00000100:00100000:2.0:1787829921.635502:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+21:10389:x1874675275694976:12345-192.168.201.51@tcp:101:stat.0 00010000:00010000:2.0:1787829921.635525:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829921.635546:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7c46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c87fc expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.635615:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7c4d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.635628:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7c4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.635638:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7c4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.635651:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7c54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.635657:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7c54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.635680:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7c54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.636230:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7c5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.636243:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c31 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87f5 expref: 22 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.636252:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7c5b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.636281:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c87f5 expref: 22 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.636294:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c31 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c87f5 expref: 22 pid: 5805 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829921.636307:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f383c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1874675284113408:192.168.201.51@tcp:104: 00000100:00100000:2.0:1787829921.636456:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b601e03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787829921.642443:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f383c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1874675284113408:192.168.201.51@tcp:104: 00010000:00010000:2.0:1787829921.642478:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7c5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829921.643909:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829921.644139:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275695232 00000100:00100000:2.0:1787829921.644148:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275695232 00000100:00100000:2.0:1787829921.644215:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 13 00000100:00100000:2.0:1787829921.644224:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b44cc12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+23:5598:x1874675275695232:12345-192.168.201.51@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787829921.645012:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b44cc12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+24:5598:x1874675275695232:12345-192.168.201.51@tcp:35:ldlm_bl.0 Request processed in 787us (1108us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1787829921.645054:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 13 00000100:00100000:1.0:1787829921.649149:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829921.649254:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275695360 00000100:00100000:0.0:1787829921.649265:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275695360 00010000:00010000:0.0:1787829921.649318:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c31 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c87f5 expref: 24 pid: 5805 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829921.649371:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 39 00000100:00100000:0.0:1787829921.649381:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b523843c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+24:2363:x1874675275695360:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787829921.649395:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829921.649403:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c31 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c87f5 expref: 24 pid: 5805 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829921.649415:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c87f5 expref: 24 pid: 5805 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829921.649439:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c31 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c87f5 expref: 24 pid: 5805 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829921.649457:0:8409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b45193600) 00010000:00010000:0.0:1787829921.649463:0:8409:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7c5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829921.649472:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829921.649480:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7c5b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829921.649515:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829921.649629:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b523843c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+23:2363:x1874675275695360:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 249us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829921.649637:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 39 00010000:00010000:3.0:1787829921.651095:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.651111:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829921.651164:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787829921.651168:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787829921.651214:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.651230:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.651240:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7c4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.651246:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7c4d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.651253:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7c4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.651259:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829921.651292:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7c4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.651301:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7c4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.651317:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:3.0:1787829921.651330:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829921.651336:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7c4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.651343:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7c4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.651360:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7c54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.651366:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7c54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.651372:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7c54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.651377:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3ea00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829921.651380:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7c54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.651385:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7c54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.651393:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e9b45193d00) 00010000:00010000:3.0:1787829921.651396:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829921.651405:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7c54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.651410:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7c54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.651456:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7c46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87fc expref: 23 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.651470:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7c5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87fc expref: 22 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.651478:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b45193600) 00010000:00010000:3.0:1787829921.651481:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787829921.651483:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3ec00, rc 0) 00000100:00100000:3.0:1787829921.651552:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+22:10389:x1874675275694976:12345-192.168.201.51@tcp:101:stat.0 Request processed in 16051us (17105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829921.651560:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 53 00000100:00100000:0.0:1787829921.775443:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829921.775531:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275695616 00000100:00100000:3.0:1787829921.775541:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275695616 00000100:00100000:3.0:1787829921.775616:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 54 00000100:00100000:3.0:1787829921.775626:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b42c8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+22:10395:x1874675275695616:12345-192.168.201.51@tcp:36:truncate.0 00010000:00010000:3.0:1787829921.775685:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829921.775728:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7c5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87fc expref: 22 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.775760:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b45193600) 00010000:00010000:3.0:1787829921.775766:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787829921.775974:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7c62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.775988:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7c62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.775998:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7c62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787829921.776110:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1787829921.776132:0:5805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009aef468a reply state 00000000baa0fffa transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7c62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829921.776141:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787829921.776244:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b42c8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+24:10395:x1874675275695616:12345-192.168.201.51@tcp:36:truncate.0 Request processed in 619us (811us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1787829921.776252:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 54 00000020:00080000:3.0:1787829921.776256:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787829921.780304:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7c62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.780333:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7c62 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.780340:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7c62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.780347:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164ec00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829921.780351:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7c62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.780359:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7c62 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.780394:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b45193600) 00010000:00010000:3.0:1787829921.780397:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829921.780401:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7c62 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829921.780407:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7c62 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829921.959074:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829921.959207:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275695744 00000100:00100000:2.0:1787829921.959221:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275695744 00000100:00100000:2.0:1787829921.959299:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 55 00000100:00100000:2.0:1787829921.959311:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b42c89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+23:10409:x1874675275695744:12345-192.168.201.51@tcp:101:stat.0 00010000:00010000:2.0:1787829921.959355:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829921.959385:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7c69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8803 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.959571:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7c70 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.959590:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7c70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.959602:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7c70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.959618:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7c77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.959624:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7c77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.959630:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7c77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.960180:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7c7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.960200:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7c7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.960208:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7c7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787829921.960260:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1787829921.960266:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787829921.960297:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7c7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.960311:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7c7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.960869:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7c70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.960879:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7c70 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.960886:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7c70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.960893:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f800 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829921.960898:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7c70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.960906:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7c70 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.960924:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:2.0:1787829921.960939:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829921.960946:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7c70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.960955:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7c70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.960974:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7c77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.960980:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7c77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.960987:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7c77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.960992:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f600 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829921.960995:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7c77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.961001:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7c77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.961009:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e9b45193100) 00010000:00010000:2.0:1787829921.961012:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829921.961165:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7c77 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.961173:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7c77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.961225:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7c69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8803 expref: 25 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.961255:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7c7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8803 expref: 24 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829921.961263:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b45193600) 00010000:00010000:2.0:1787829921.961265:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787829921.961279:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3fa00, rc 0) 00000100:00100000:2.0:1787829921.961377:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b42c89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+24:10409:x1874675275695744:12345-192.168.201.51@tcp:101:stat.0 Request processed in 2068us (2364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829921.961386:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 55 00000100:00100000:1.0:1787829922.067897:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829922.068012:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275696000 00000100:00100000:3.0:1787829922.068051:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275696000 00000100:00100000:3.0:1787829922.068128:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 56 00000100:00100000:3.0:1787829922.068142:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+24:10419:x1874675275696000:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:3.0:1787829922.068172:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829922.068198:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7c85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c880a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829922.068667:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787829922.068892:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7c85 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c880a expref: 26 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.068912:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b45193f00) 00010000:00010000:3.0:1787829922.068916:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787829922.068922:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7c85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c880a expref: 26 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.068938:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164ec00, rc 0) 00000100:00100000:3.0:1787829922.069090:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+25:10419:x1874675275696000:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 950us (1208us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1787829922.069111:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 56 00000100:00100000:1.0:1787829922.077294:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829922.077486:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275696256 00000100:00100000:2.0:1787829922.077498:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275696256 00000100:00100000:2.0:1787829922.077577:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 14 00000100:00100000:2.0:1787829922.077588:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52384f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+25:10419:x1874675275696256:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:2.0:1787829922.078171:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52384f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+26:10419:x1874675275696256:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 582us (889us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787829922.078180:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 14 00000100:00100000:0.0:1787829922.138690:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829922.138799:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275696512 00000100:00100000:3.0:1787829922.138813:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275696512 00000100:00100000:3.0:1787829922.138890:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 57 00000100:00100000:3.0:1787829922.138902:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b42c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+26:10426:x1874675275696512:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:3.0:1787829922.138937:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829922.138976:0:7257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7c93 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8811 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.139165:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c9a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.139184:0:7257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7c7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8803 expref: 27 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.139194:0:7257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c9a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.139238:0:7257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7c7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8803 expref: 27 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.139252:0:7257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7c7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8803 expref: 27 pid: 5804 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829922.139447:0:7257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4d6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7257:1874675284113536:192.168.201.51@tcp:104: 00000100:00100000:3.0:1787829922.139636:0:7257:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b81e320c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787829922.146907:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829922.147061:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275696640 00000100:00100000:0.0:1787829922.147074:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275696640 00010000:00010000:0.0:1787829922.147131:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7c7e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8803 expref: 28 pid: 5804 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829922.147187:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 40 00000100:00100000:0.0:1787829922.147199:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52385680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+28:2362:x1874675275696640:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787829922.147221:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829922.147228:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7c7e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8803 expref: 28 pid: 5804 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829922.147244:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7c7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8803 expref: 28 pid: 5804 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829922.147278:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b45193600) 00010000:00010000:0.0:1787829922.147286:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c9a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829922.147298:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c9a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829922.147308:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c9a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829922.147352:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829922.147427:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52385680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+28:2362:x1874675275696640:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 230us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829922.147437:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 40 00010000:00010000:3.0:1787829922.148008:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7c7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8803 expref: 27 pid: 5804 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829922.148056:0:7257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4d6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7257:1874675284113536:192.168.201.51@tcp:104: 00010000:00010000:3.0:1787829922.148081:0:7257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c9a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.148092:0:7257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c9a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.148098:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c9a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829922.148120:0:7257:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1787829922.148380:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7c93 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8811 expref: 28 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.148400:0:7257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c9a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8811 expref: 27 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.148408:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b45193600) 00010000:00010000:3.0:1787829922.148412:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787829922.148415:0:7257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164fc00, rc 0) 00000100:00100000:3.0:1787829922.149434:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b42c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+27:10426:x1874675275696512:12345-192.168.201.51@tcp:101:bash.0 Request processed in 10525us (10749us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1787829922.149446:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 57 00000100:00100000:1.0:1787829922.152544:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829922.152656:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275696896 00000100:00100000:2.0:1787829922.152669:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275696896 00000100:00100000:2.0:1787829922.152770:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 58 00000100:00100000:2.0:1787829922.152781:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52386940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+27:10426:x1874675275696896:12345-192.168.201.51@tcp:36:bash.0 00010000:00010000:2.0:1787829922.153174:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7ca8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.153199:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7ca8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.153235:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7ca8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787829922.153385:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1787829922.153416:0:5804:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043c8def5 reply state 000000009b166877 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7ca8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829922.153427:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787829922.153615:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52386940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+30:10426:x1874675275696896:12345-192.168.201.51@tcp:36:bash.0 Request processed in 835us (1085us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787829922.153623:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 58 00000020:00080000:2.0:1787829922.153630:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787829922.163203:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7ca8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.163230:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7ca8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.163240:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7ca8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.163247:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f800 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829922.163254:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7ca8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.163274:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7ca8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.163300:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b45193600) 00010000:00010000:1.0:1787829922.163303:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829922.163310:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7ca8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.163326:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7ca8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829922.164720:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829922.164879:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275697024 00000100:00100000:3.0:1787829922.164892:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275697024 00000100:00100000:3.0:1787829922.164972:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 59 00000100:00100000:3.0:1787829922.164983:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52387840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+29:10426:x1874675275697024:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:3.0:1787829922.165057:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829922.165081:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7caf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8818 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.165189:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7cb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.165207:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c9a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8811 expref: 30 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.165217:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7cb6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.165262:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c9a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8811 expref: 30 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.165862:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c9a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8811 expref: 30 pid: 7257 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829922.165881:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4d6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1874675284113664:192.168.201.51@tcp:104: 00000100:00100000:3.0:1787829922.166010:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b81e32cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787829922.169813:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829922.169906:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275697152 00000100:00100000:0.0:1787829922.169918:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275697152 00010000:00010000:0.0:1787829922.169987:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c9a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8811 expref: 31 pid: 7257 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829922.170070:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 41 00000100:00100000:0.0:1787829922.170081:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f383c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+31:2363:x1874675275697152:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787829922.170106:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829922.170115:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c9a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8811 expref: 31 pid: 7257 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829922.170131:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c9a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8811 expref: 31 pid: 7257 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829922.170161:0:8409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b45193600) 00010000:00010000:0.0:1787829922.170168:0:8409:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7cb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829922.170179:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829922.170187:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7cb6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829922.170230:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829922.170312:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f383c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+31:2363:x1874675275697152:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 233us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829922.170321:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 41 00010000:00010000:3.0:1787829922.171166:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7c9a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8811 expref: 30 pid: 7257 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829922.171191:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4d6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1874675284113664:192.168.201.51@tcp:104: 00010000:00010000:3.0:1787829922.171219:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.171246:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.171253:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829922.171337:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787829922.171343:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787829922.171367:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.171413:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7caf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8818 expref: 30 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.171430:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8818 expref: 29 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.171441:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b45193600) 00010000:00010000:3.0:1787829922.171444:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787829922.171448:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164e200, rc 0) 00000100:00100000:3.0:1787829922.171514:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52387840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+29:10426:x1874675275697024:12345-192.168.201.51@tcp:101:bash.0 Request processed in 6532us (6805us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829922.171523:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 59 00000100:00100000:2.0:1787829922.176667:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829922.176788:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275697408 00000100:00100000:1.0:1787829922.176801:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275697408 00000100:00100000:1.0:1787829922.176874:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 15 00000100:00100000:1.0:1787829922.176885:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b50361450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+29:10426:x1874675275697408:12345-192.168.201.51@tcp:35:bash.0 00000100:00100000:1.0:1787829922.177245:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b50361450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+30:10426:x1874675275697408:12345-192.168.201.51@tcp:35:bash.0 Request processed in 360us (590us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1787829922.178132:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 15 00000100:00100000:0.0:1787829922.263771:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829922.263879:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275697664 00000100:00100000:3.0:1787829922.263893:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275697664 00000100:00100000:3.0:1787829922.264237:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 60 00000100:00100000:3.0:1787829922.264249:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b42c88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+30:10436:x1874675275697664:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:3.0:1787829922.264292:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829922.264346:0:7257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7cbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c881f expref: -99 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829922.264687:0:7257:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787829922.264903:0:7257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7cbd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c881f expref: 32 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.264921:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b45193f00) 00010000:00010000:3.0:1787829922.264924:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787829922.264930:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7cbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c881f expref: 32 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.264945:0:7257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164ec00, rc 0) 00000100:00100000:0.0:1787829922.265915:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b42c88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+31:10436:x1874675275697664:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 1658us (2187us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1787829922.265927:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 60 00000100:00100000:1.0:1787829922.271631:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829922.271888:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275697792 00000100:00100000:2.0:1787829922.271903:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275697792 00000100:00100000:2.0:1787829922.271986:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 61 00000100:00100000:2.0:1787829922.271998:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52384f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+31:10436:x1874675275697792:12345-192.168.201.51@tcp:34:lfs.0 00010000:00010000:2.0:1787829922.272117:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d7ccb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.272138:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d7ccb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.272151:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d7ccb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.272168:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7cd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.272196:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.272203:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.273497:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7cd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.273519:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.273531:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787829922.273595:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.273611:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d7ccb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.273619:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d7ccb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.273626:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d7ccb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.273633:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3e000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829922.273638:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d7ccb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.273647:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d7ccb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.273671:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:2.0:1787829922.273674:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829922.273679:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d7ccb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.273687:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d7ccb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.273703:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.273710:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7cd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.273716:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.273721:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f800 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829922.273735:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.273742:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7cd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.273750:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e9b45193100) 00010000:00010000:2.0:1787829922.273752:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829922.273756:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7cd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.273762:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7cd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.273790:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.273798:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7cd9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.273804:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7cd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.273809:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3fa00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829922.273812:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7cd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.273819:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7cd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.273825:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b45193600) 00010000:00010000:2.0:1787829922.273827:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829922.273830:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7cd9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.273836:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7cd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829922.274139:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52384f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+31:10436:x1874675275697792:12345-192.168.201.51@tcp:34:lfs.0 Request processed in 2137us (2517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829922.274152:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 61 00000100:00100000:1.0:1787829922.282618:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829922.282731:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275698048 00000100:00100000:2.0:1787829922.282746:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275698048 00000100:00100000:2.0:1787829922.282862:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 16 00000100:00100000:2.0:1787829922.282890:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52387c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+31:10436:x1874675275698048:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:2.0:1787829922.283929:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52387c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+32:10436:x1874675275698048:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 1033us (1319us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787829922.283941:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 16 00000100:00100000:1.0:1787829922.318655:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829922.318947:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275698304 00000100:00100000:3.0:1787829922.318957:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275698304 00000100:00100000:3.0:1787829922.319114:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 62 00000100:00100000:3.0:1787829922.319126:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b523861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+32:10439:x1874675275698304:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:3.0:1787829922.319149:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829922.319170:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7ce0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8826 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.319261:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7ce7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.319276:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.319287:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.319310:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7cee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.319318:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7cee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.319325:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7cee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.319954:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7cf5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.319967:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.319975:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829922.319985:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787829922.320158:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.320166:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7ce7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.320173:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7ce7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.320179:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164fc00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829922.320183:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7ce7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.320200:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7ce7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.320211:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:3.0:1787829922.320214:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829922.320218:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7ce7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.320223:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7ce7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.320235:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7cee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.320241:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7cee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.320247:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7cee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.320252:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164e400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829922.320254:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7cee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.320259:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7cee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.320265:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e9b478ccc00) 00010000:00010000:3.0:1787829922.320267:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829922.320270:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7cee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.320283:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7cee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.320326:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7ce0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8826 expref: 35 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.320339:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7cf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8826 expref: 34 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.320345:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b45193600) 00010000:00010000:3.0:1787829922.320347:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787829922.320350:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164e600, rc 0) 00000100:00100000:3.0:1787829922.320602:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b523861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+34:10439:x1874675275698304:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 1478us (1956us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1787829922.320612:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 62 00000100:00100000:1.0:1787829922.324570:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829922.324603:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829922.324679:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275698560 00000100:00100000:0.0:1787829922.324689:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275698560 00000100:00100000:0.0:1787829922.324764:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 4 00000100:00100000:0.0:1787829922.324772:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52385a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+34:2363:x1874675275698560:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787829922.324785:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829922.324806:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7cf5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8826 expref: 34 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829922.324822:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b45193600) 00010000:00010000:0.0:1787829922.324826:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829922.324872:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52385a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+33:2363:x1874675275698560:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 102us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829922.324878:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 4 00000100:00100000:2.0:1787829922.327364:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275698432 00000100:00100000:2.0:1787829922.327376:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275698432 00000100:00100000:2.0:1787829922.327437:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 63 00000100:00100000:2.0:1787829922.327447:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52386580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+33:10439:x1874675275698432:12345-192.168.201.51@tcp:54:lfs.0 00010000:00010000:2.0:1787829922.327519:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7d03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.327538:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7d03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.327549:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7d03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.327576:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7d03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.327582:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7d03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.327587:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7d03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.327594:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3fa00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829922.327599:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7d03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.327623:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7d03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.327634:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b45193600) 00010000:00010000:2.0:1787829922.327637:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787829922.327642:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7d03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829922.327649:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7d03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829922.327713:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52386580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+33:10439:x1874675275698432:12345-192.168.201.51@tcp:54:lfs.0 Request processed in 267us (3148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829922.327721:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 63 00000100:00100000:1.0:1787829922.335189:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829922.335414:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275698816 00000100:00100000:0.0:1787829922.335424:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275698816 00000100:00100000:0.0:1787829922.335487:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 17 00000100:00100000:0.0:1787829922.335497:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+33:10439:x1874675275698816:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:0.0:1787829922.335759:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+34:10439:x1874675275698816:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 263us (590us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1787829922.335767:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 17 00010000:00010000:2.0:1787829922.466705:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829922.466801:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829922.466931:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275699072 00000100:00100000:0.0:1787829922.466941:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275699072 00000100:00100000:0.0:1787829922.467005:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 64 00000100:00100000:0.0:1787829922.467043:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52384b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+34:10457:x1874675275699072:12345-192.168.201.51@tcp:101:cat.0 00010000:00010000:0.0:1787829922.467078:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829922.467100:0:7257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d7d0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c882d expref: -99 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829922.467200:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ec00/0xc03b4d103c0d7d11 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829922.467216:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ec00/0xc03b4d103c0d7d11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829922.467227:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ec00/0xc03b4d103c0d7d11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787829922.467237:0:7257:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787829922.467378:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d7d0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c882d expref: 37 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829922.467398:0:7257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ec00/0xc03b4d103c0d7d11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c882d expref: 36 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829922.467406:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b45193600) 00010000:00010000:0.0:1787829922.467422:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787829922.467427:0:7257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7fa7ec00, rc 0) 00000100:00100000:0.0:1787829922.467494:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52384b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+36:10457:x1874675275699072:12345-192.168.201.51@tcp:101:cat.0 Request processed in 479us (701us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787829922.467501:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 64 00000100:00100000:1.0:1787829922.504540:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829922.505281:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275699200 00000100:00100000:3.0:1787829922.505292:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275699200 00000100:00100000:3.0:1787829922.505360:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 65 00000100:00100000:3.0:1787829922.505370:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52386d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+36:10458:x1874675275699200:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:3.0:1787829922.505393:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829922.505415:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7d1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8834 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.505482:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7d26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.505498:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.505523:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829922.505732:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787829922.505736:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787829922.505814:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.505843:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7d1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8834 expref: 38 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.505863:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7d26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8834 expref: 37 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829922.505872:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:3.0:1787829922.505875:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787829922.505879:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164e400, rc 0) 00000100:00100000:3.0:1787829922.505952:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52386d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+37:10458:x1874675275699200:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 583us (1424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829922.505959:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 65 00000100:00100000:2.0:1787829922.511784:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829922.512595:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275699584 00000100:00100000:0.0:1787829922.512607:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275699584 00000100:00100000:0.0:1787829922.512671:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 18 00000100:00100000:0.0:1787829922.512682:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f383480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+37:10458:x1874675275699584:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:0.0:1787829922.513172:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f383480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+38:10458:x1874675275699584:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 491us (1397us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1787829922.513193:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 18 00000100:00100000:1.0:1787829922.519153:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829922.520147:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275699712 00000100:00100000:0.0:1787829922.520159:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275699712 00000100:00100000:0.0:1787829922.520244:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 5 00000100:00100000:0.0:1787829922.520502:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52384780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+38:10458:x1874675275699712:12345-192.168.201.51@tcp:103:lfs.0 00010000:00010000:0.0:1787829922.520520:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787829922.520547:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7cb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8818 expref: 38 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829922.520569:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ec00/0xc03b4d103c0d7d11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c882d expref: 37 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829922.520581:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fe00/0xc03b4d103c0d7bba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87d9 expref: 36 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829922.520591:0:8409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b45193600) 00010000:00010000:0.0:1787829922.520617:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829922.520684:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52384780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+35:10458:x1874675275699712:12345-192.168.201.51@tcp:103:lfs.0 Request processed in 187us (1540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829922.520693:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 5 00000100:00100000:1.0:1787829922.523650:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829922.523888:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275699840 00000100:00100000:0.0:1787829922.523902:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275699840 00000100:00100000:0.0:1787829922.525067:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 66 00000100:00100000:0.0:1787829922.525093:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b523870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+35:10458:x1874675275699840:12345-192.168.201.51@tcp:58:lfs.0 00010000:00010000:0.0:1787829922.525280:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d7d2d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829922.525302:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d7d2d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829922.525317:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d7d2d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787829922.526156:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787829922.526354:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1787829922.526415:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1787829922.526542:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b523870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+35:10458:x1874675275699840:12345-192.168.201.51@tcp:58:lfs.0 Request processed in 1457us (2900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829922.526554:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 66 00000100:00100000:2.0:1787829922.546677:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829922.546792:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275699968 00000100:00100000:1.0:1787829922.546804:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275699968 00000100:00100000:1.0:1787829922.546866:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 67 00000100:00100000:1.0:1787829922.546878:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+35:10460:x1874675275699968:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:1.0:1787829922.546909:0:10044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829922.546934:0:10044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d7d34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c883b expref: -99 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.547081:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d7d3b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.547096:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d7d3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.547106:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d7d3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.547139:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7d42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.547144:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7d42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.547148:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7d42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.547942:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7d49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.548202:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7d49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.548213:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7d49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787829922.548266:0:10044:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787829922.548271:0:10044:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787829922.548296:0:10044:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7d49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.548310:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7d49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.548320:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d7d3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.548327:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d7d3b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.548350:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d7d3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.548356:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feee200 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829922.548361:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d7d3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.548371:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d7d3b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.548386:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:1.0:1787829922.548390:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829922.548396:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d7d3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.548403:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d7d3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.548418:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7d42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.548425:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7d42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.548432:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7d42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.548437:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feefc00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829922.548440:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7d42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.548457:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7d42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.548466:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e9b507a7900) 00010000:00010000:1.0:1787829922.548468:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829922.548472:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7d42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.548477:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7d42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.548520:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d7d34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c883b expref: 37 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.548537:0:10044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7d49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c883b expref: 36 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829922.548546:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b48f25000) 00010000:00010000:1.0:1787829922.548548:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787829922.548551:0:10044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feee600, rc 0) 00000100:00100000:1.0:1787829922.548652:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+36:10460:x1874675275699968:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 1775us (1990us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829922.548662:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 67 00000100:00100000:0.0:1787829922.659496:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b42c89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284114176:0@lo:400:kworker.0 00000100:00100000:2.0:1787829922.659710:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b42c88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874675284113920:0@lo:400:kworker.0 00000100:00100000:3.0:1787829922.659841:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b42c8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284114048:0@lo:400:kworker.0 00000100:00100000:1.0:1787829922.660657:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b42c8ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284113792:0@lo:400:kworker.0 00000100:00100000:2.0:1787829922.661060:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829922.661138:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b42c883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284114432:0@lo:400:kworker.0 00000100:00100000:2.0:1787829922.661172:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829922.661229:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284113920 00000100:00100000:2.0:1787829922.661239:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284113920 00000100:00100000:2.0:1787829922.661849:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787829922.661864:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f546940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1874675284113920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829922.661950:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f546940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1874675284113920:12345-0@lo:400:kworker.0 Request processed in 91us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829922.661991:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787829922.662049:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284114432 00000100:00100000:2.0:1787829922.662054:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284114432 00000100:00100000:2.0:1787829922.662102:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787829922.662110:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3279:x1874675284114432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829922.662147:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3279:x1874675284114432:12345-0@lo:400:kworker.0 Request processed in 38us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829922.662154:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1787829922.662176:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787829922.662222:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b42c88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874675284113920:0@lo:400:kworker.0 00000100:00100000:2.0:1787829922.662237:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b42c883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284114432:0@lo:400:kworker.0 00000100:00100000:3.0:1787829922.663182:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829922.663230:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284114560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787829922.663281:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829922.663357:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284114048 00000100:00100000:3.0:1787829922.663363:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284114048 00000100:00100000:3.0:1787829922.663414:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787829922.663438:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284114048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829922.663488:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284114048:12345-0@lo:400:kworker.0 Request processed in 52us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829922.663495:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1787829922.663529:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787829922.663696:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b42c8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284114048:0@lo:400:kworker.0 00000100:00100000:3.0:1787829922.663750:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284114560 00000100:00100000:3.0:1787829922.663755:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284114560 00000100:00100000:3.0:1787829922.663793:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787829922.663800:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284114560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787829922.663840:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787829922.663881:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284114560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829922.663887:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1787829922.663907:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787829922.663933:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284114560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787829922.667791:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829922.669458:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829922.669512:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b42c892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284114304:0@lo:400:kworker.0 00000100:00100000:1.0:1787829922.669578:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829922.671819:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284114304 00000100:00100000:0.0:1787829922.671838:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284114304 00000100:00100000:0.0:1787829922.671965:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787829922.671980:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1874675284114304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829922.672159:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1874675284114304:12345-0@lo:400:kworker.0 Request processed in 182us (2578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829922.672168:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1787829922.672200:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787829922.673594:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b42c892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284114304:0@lo:400:kworker.0 00000100:00100000:3.0:1787829922.675496:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284114176 00000100:00100000:3.0:1787829922.675513:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284114176 00000100:00100000:3.0:1787829922.675822:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787829922.675835:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b42c88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284114176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829922.675956:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b42c88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284114176:12345-0@lo:400:kworker.0 Request processed in 124us (8177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829922.675964:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787829922.675995:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284113792 00000100:00100000:3.0:1787829922.675999:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284113792 00000100:00100000:3.0:1787829922.676049:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787829922.676057:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3278:x1874675284113792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829922.676114:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3278:x1874675284113792:12345-0@lo:400:kworker.0 Request processed in 59us (6665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829922.676120:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787829922.676184:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b42c8ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284113792:0@lo:400:kworker.0 00000100:00100000:0.0:1787829922.676459:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b42c89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284114176:0@lo:400:kworker.0 00000040:00080000:0.0:1787829923.050796:0:11648:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787829923.050806:0:11648:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787829923.050860:0:11648:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787829923.050867:0:11648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787829923.051057:0:11648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b42c89e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11648:1874675284114688:192.168.201.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787829923.051173:0:11648:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51060f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787829923.059687:0:11648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b42c89e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11648:1874675284114688:192.168.201.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787829923.072607:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829923.073110:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275700096 00000100:00100000:3.0:1787829923.073128:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275700096 00000100:00100000:3.0:1787829923.073228:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 1 00000100:00100000:3.0:1787829923.073241:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f545e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b6abf229-545c-43fd-8dee-d9adf582be48+36:10471:x1874675275700096:12345-192.168.201.51@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787829923.073350:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f545e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b6abf229-545c-43fd-8dee-d9adf582be48+36:10471:x1874675275700096:12345-192.168.201.51@tcp:900:lhsmtool_posix.0 Request processed in 112us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829923.073358:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 1 00000100:00080000:1.0:1787829923.075122:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787829923.087132:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829923.089828:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275700224 00000100:00100000:0.0:1787829923.089846:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275700224 00000100:00100000:0.0:1787829923.089935:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 68 00000100:00100000:0.0:1787829923.089949:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+36:10471:x1874675275700224:12345-192.168.201.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787829923.089996:0:7257:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787829923.090326:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+36:10471:x1874675275700224:12345-192.168.201.51@tcp:53:lhsmtool_posix.0 Request processed in 378us (3321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829923.090335:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 68 00000100:00100000:1.0:1787829923.103362:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829923.105080:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275700352 00000100:00100000:2.0:1787829923.105105:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275700352 00000100:00100000:1.0:1787829923.107897:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 69 00000100:00100000:1.0:1787829923.107928:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f328780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+36:10471:x1874675275700352:12345-192.168.201.51@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787829923.108061:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7d50 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.108085:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7d50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.108102:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7d50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.109620:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d7d57 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.109646:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d7d57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.109659:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d7d57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.109699:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7d5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.109707:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7d5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.109728:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7d5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787829923.109801:0:10044:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787829923.109807:0:10044:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787829923.109827:0:10044:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7d5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.109854:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7d50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.109862:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7d50 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.109870:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7d50 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.109877:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feef000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829923.109883:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7d50 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.109892:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7d50 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.109910:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e9b45193300) 00010000:00010000:1.0:1787829923.109913:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829923.109919:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7d50 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.109926:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7d50 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.109949:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d7d57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.109967:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d7d57 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.109974:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d7d57 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.109979:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feef400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829923.109983:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d7d57 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.109990:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d7d57 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.109999:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9e9b507a7900) 00010000:00010000:1.0:1787829923.110002:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829923.110005:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d7d57 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.110011:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d7d57 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.110082:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7d5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.110089:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7d5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.110096:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7d5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.110102:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feeec00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829923.110114:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7d5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.110120:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7d5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.110130:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b48f25000) 00010000:00010000:1.0:1787829923.110133:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829923.110136:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7d5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.110156:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7d5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829923.110261:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f328780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+36:10471:x1874675275700352:12345-192.168.201.51@tcp:34:lhsmtool_posix.0 Request processed in 2338us (6905us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829923.110275:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 69 00000100:00100000:2.0:1787829923.112534:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829923.112729:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275700608 00000100:00100000:0.0:1787829923.112744:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275700608 00000100:00100000:0.0:1787829923.112820:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 70 00000100:00100000:0.0:1787829923.112832:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f547840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+36:10471:x1874675275700608:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787829923.112862:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829923.112911:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ec00/0xc03b4d103c0d7d65 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8842 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.113077:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7d6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.113098:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7d6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.113112:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7d6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787829923.113124:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787829923.113324:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7d6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.113333:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7d6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.113341:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7d6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.113347:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7f400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829923.113352:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7d6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.113361:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7d6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.113376:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b48f25000) 00010000:00010000:0.0:1787829923.113389:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787829923.113394:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7d6c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.113410:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7d6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.113466:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ec00/0xc03b4d103c0d7d65 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8842 expref: 38 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.113478:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e9b45193300) 00010000:00010000:0.0:1787829923.113481:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787829923.113485:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ec00/0xc03b4d103c0d7d65 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8842 expref: 38 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.113495:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7fa7ec00, rc 0) 00000100:00100000:0.0:1787829923.113913:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f547840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+37:10471:x1874675275700608:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 1080us (1397us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1787829923.113924:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 70 00000100:00100000:3.0:1787829923.121118:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829923.121243:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275700736 00000100:00100000:0.0:1787829923.121258:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275700736 00000100:00100000:0.0:1787829923.121343:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 71 00000100:00100000:0.0:1787829923.121362:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+37:10471:x1874675275700736:12345-192.168.201.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787829923.121489:0:7257:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787829923.121655:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+37:10471:x1874675275700736:12345-192.168.201.51@tcp:53:lhsmtool_posix.0 Request processed in 299us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829923.121663:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 71 00000100:00100000:3.0:1787829923.124175:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829923.124280:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275700992 00000100:00100000:1.0:1787829923.124294:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275700992 00000100:00100000:1.0:1787829923.124370:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 72 00000100:00100000:1.0:1787829923.124384:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b47a78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+37:10471:x1874675275700992:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787829923.124407:0:10044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829923.124410:0:10044:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787829923.124442:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7d26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8834 expref: 37 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.124463:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:1.0:1787829923.124467:0:10044:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787829923.124481:0:10044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7d7a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8849 expref: -99 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787829923.126946:0:10044:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1787829923.128324:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ec00/0xc03b4d103c0d7d81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.128350:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ec00/0xc03b4d103c0d7d81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.128574:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ec00/0xc03b4d103c0d7d81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.128677:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7d7a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8849 expref: 39 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.128701:0:10044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ec00/0xc03b4d103c0d7d81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8849 expref: 38 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.128718:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e9b48f25700) 00010000:00010000:0.0:1787829923.128722:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787829923.128727:0:10044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7fa7ec00, rc 0) 00000100:00100000:0.0:1787829923.128879:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b47a78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+38:10471:x1874675275700992:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 4499us (4715us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1787829923.128891:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 72 00000100:00100000:0.0:1787829923.136765:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829923.137539:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275701248 00000100:00100000:2.0:1787829923.137556:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275701248 00000100:00100000:2.0:1787829923.137648:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 73 00000100:00100000:2.0:1787829923.137661:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b42c89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+38:10471:x1874675275701248:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787829923.137755:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829923.137792:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ec00/0xc03b4d103c0d7d81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8849 expref: 38 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.137816:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e9b48f25700) 00010000:00010000:2.0:1787829923.137831:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787829923.138279:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7d8f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.138324:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7d8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.138337:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7d8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.138359:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7d96 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xc001dc53 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.138367:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7d96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc001dc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.138373:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7d96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc001dc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.138746:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7d8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.138756:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7d8f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.138764:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7d8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.138770:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f200 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829923.138775:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7d8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.138783:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7d8f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.138795:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:2.0:1787829923.138804:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829923.138811:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7d8f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.138818:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7d8f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.138831:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7d96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc001dc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.138838:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7d96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc001dc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.138843:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7d96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc001dc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.138848:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3ea00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829923.138851:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7d96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc001dc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.138857:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7d96 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc001dc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.138865:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xc001dc53 (ffff9e9b45193100) 00010000:00010000:2.0:1787829923.138868:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829923.138870:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7d96 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc001dc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.138876:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7d96 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc001dc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829923.139002:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b42c89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+37:10471:x1874675275701248:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 Request processed in 1340us (2249us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787829923.139041:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 73 00000100:00100000:3.0:1787829923.144280:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829923.147304:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275701376 00000100:00100000:0.0:1787829923.147327:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275701376 00000100:00100000:0.0:1787829923.147443:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 74 00000100:00100000:0.0:1787829923.147456:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+37:10471:x1874675275701376:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787829923.147484:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829923.147517:0:7257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7d9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8850 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.147564:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e800/0xc03b4d103c0d7da4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.147602:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e800/0xc03b4d103c0d7da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.147617:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e800/0xc03b4d103c0d7da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.147752:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7d9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8850 expref: 39 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.147774:0:7257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e800/0xc03b4d103c0d7da4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8850 expref: 38 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.147783:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e9b48f25d00) 00010000:00010000:0.0:1787829923.147787:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787829923.147791:0:7257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7fa7e800, rc 0) 00000100:00100000:0.0:1787829923.147888:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+38:10471:x1874675275701376:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 435us (3637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829923.147896:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 74 00000100:00100000:1.0:1787829923.154108:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829923.154261:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275701632 00000100:00100000:0.0:1787829923.154274:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275701632 00000100:00100000:0.0:1787829923.154355:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 75 00000100:00100000:0.0:1787829923.154367:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b44cc12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+38:10471:x1874675275701632:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787829923.154492:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7dab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.154516:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7dab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.154552:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7dab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787829923.155375:0:10044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1787829923.155403:0:10044:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 303056385034ns, next at 304056371824ns, rc = 0 00000004:00010000:0.0:1787829923.155528:0:10044:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d37114a0 reply state 00000000f4a48d60 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7dab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829923.155540:0:10044:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787829923.155690:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b44cc12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+40:10471:x1874675275701632:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 Request processed in 1321us (1595us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1787829923.155702:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 75 00010000:00010000:3.0:1787829923.160855:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7dab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.160881:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7dab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.160890:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7dab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.160897:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7f400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829923.160903:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7dab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.160937:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7dab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.160961:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e9b48f25d00) 00010000:00010000:3.0:1787829923.160964:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787829923.160971:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7dab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.160978:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7dab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829923.163452:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829923.163738:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275701760 00000100:00100000:3.0:1787829923.163752:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275701760 00000100:00100000:3.0:1787829923.163834:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 76 00000100:00100000:3.0:1787829923.163847:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ed2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+39:10471:x1874675275701760:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787829923.163882:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829923.163912:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7db2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8857 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.163997:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7db2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8857 expref: 40 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.164014:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7db2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8857 expref: 40 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.164078:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e9b48f25d00) 00010000:00010000:3.0:1787829923.164081:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787829923.164086:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164e200, rc 0) 00000100:00100000:3.0:1787829923.164170:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ed2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+40:10471:x1874675275701760:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 326us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829923.164178:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 76 00000100:00100000:3.0:1787829923.173549:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284114816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787829923.173558:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829923.173603:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275701888 00000100:00100000:3.0:1787829923.173625:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829923.173625:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275701888 00000100:00100000:2.0:1787829923.173684:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 25 00000100:00100000:2.0:1787829923.173696:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f545680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2359:x1874675275701888:12345-192.168.201.51@tcp:8:lhsmtool_posix.0 00000100:00100000:3.0:1787829923.173727:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284114816 00000100:00100000:3.0:1787829923.173732:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284114816 00010000:00080000:2.0:1787829923.173747:0:6651:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b6abf229-545c-43fd-8dee-d9adf582be48@192.168.201.51@tcp t0 exp 0000000000000000 cur 303 last 0 00000100:00100000:3.0:1787829923.173777:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787829923.173786:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1874675284114816:12345-0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1787829923.173799:0:6651:0:(genops.c:1385:class_connect()) connect: client b6abf229-545c-43fd-8dee-d9adf582be48, cookie 0xc03b4d103c0d7db9 00002000:00100000:2.0:1787829923.173818:0:6651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b6abf229-545c-43fd-8dee-d9adf582be48/ffff9e9b43ebe000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00000024:3.0:1787829923.173832:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00002000:00100000:2.0:1787829923.173836:0:6651:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00000100:00100000:3.0:1787829923.173887:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1874675284114816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829923.173895:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787829923.173986:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284114816:0@lo:13:osp-pre-1-0.0 00002000:00080000:2.0:1787829923.175524:0:6651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787829923.175579:0:6651:0:(import.c:65:import_set_state_nolock()) ffff9e9b43eba000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787829923.175684:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f545680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+6:2359:x1874675275701888:12345-192.168.201.51@tcp:8:lhsmtool_posix.0 Request processed in 1988us (2132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829923.175697:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 25 00000100:00100000:1.0:1787829923.194810:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829923.196131:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275702016 00000100:00100000:1.0:1787829923.196159:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275702016 00000100:00080000:0.0:1787829923.196495:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787829923.196704:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 26 00000100:00100000:1.0:1787829923.196755:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+6:0:x1874675275702016:12345-192.168.201.51@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787829923.263793:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+7:0:x1874675275702016:12345-192.168.201.51@tcp:2:lhsmtool_posix.0 Request processed in 67030us (68983us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787829923.263810:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 26 00000001:00080000:2.0:1787829923.263858:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:2.0:1787829923.263873:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b6abf229-545c-43fd-8dee-d9adf582be48 00000100:00100000:3.0:1787829923.270097:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829923.270262:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275702272 00000100:00100000:2.0:1787829923.270276:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275702272 00000100:00100000:2.0:1787829923.270360:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 19 00000100:00100000:2.0:1787829923.270372:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+40:10471:x1874675275702272:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787829923.270718:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+41:10471:x1874675275702272:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 Request processed in 336us (625us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1787829923.270727:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 19 00000100:00100000:2.0:1787829923.278266:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829923.278462:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275702528 00000100:00100000:1.0:1787829923.278474:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275702528 00000100:00100000:1.0:1787829923.278549:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 77 00000100:00100000:1.0:1787829923.278562:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b59692940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+41:10471:x1874675275702528:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787829923.278716:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b59692940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+41:10471:x1874675275702528:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 Request processed in 147us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829923.278725:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 77 00000100:00100000:1.0:1787829923.281653:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829923.281949:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275702656 00000100:00100000:2.0:1787829923.281963:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275702656 00000100:00100000:2.0:1787829923.282083:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 78 00000100:00100000:2.0:1787829923.282095:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+41:10471:x1874675275702656:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787829923.282124:0:10044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829923.282153:0:10044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7dc0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c885e expref: -99 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.282284:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7dc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.282312:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.282326:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787829923.282373:0:10044:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787829923.282398:0:10044:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.282427:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7dc0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c885e expref: 43 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.282447:0:10044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7dc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c885e expref: 42 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.282464:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e9b48f25d00) 00010000:00010000:2.0:1787829923.282467:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787829923.282471:0:10044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3f400, rc 0) 00000100:00100000:2.0:1787829923.282548:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+42:10471:x1874675275702656:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 456us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829923.282556:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 78 00000100:00100000:1.0:1787829923.285985:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829923.286100:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275702784 00000100:00100000:2.0:1787829923.286112:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275702784 00000100:00100000:2.0:1787829923.286191:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 27 00000100:00100000:2.0:1787829923.286202:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7489c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+5:2362:x1874675275702784:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787829923.286226:0:6651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829923.286262:0:6651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009863dc01/0xc03b4d103c0d7dce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8865 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787829923.286304:0:6651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a901ea3, blocks: 0x1 00010000:00010000:2.0:1787829923.286329:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=303s v=(0 0) 00010000:00010000:2.0:1787829923.286334:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787829923.286346:0:6651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009863dc01/0xc03b4d103c0d7dce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8865 expref: 6 pid: 6651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.286368:0:6651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009863dc01/0xc03b4d103c0d7dce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8865 expref: 6 pid: 6651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.286387:0:6651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3e600, rc 0) 00000100:00100000:2.0:1787829923.286467:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7489c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+6:2362:x1874675275702784:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 266us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829923.286476:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 27 00000100:00100000:1.0:1787829923.294256:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829923.294403:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275703040 00000100:00100000:3.0:1787829923.294416:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275703040 00000100:00100000:3.0:1787829923.294487:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 79 00000100:00100000:3.0:1787829923.294498:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7489f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+42:10471:x1874675275703040:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787829923.294642:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7489f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+42:10471:x1874675275703040:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 Request processed in 144us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829923.294650:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 79 00000100:00100000:1.0:1787829923.297228:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829923.298415:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275703168 00000100:00100000:3.0:1787829923.298429:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275703168 00000100:00100000:3.0:1787829923.298508:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 28 00000100:00100000:3.0:1787829923.298520:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7489de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+6:10471:x1874675275703168:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787829923.298555:0:6650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829923.298579:0:6650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3801099/0xc03b4d103c0d7dd5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c886c expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.298620:0:6650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009863dc01/0xc03b4d103c0d7dce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8865 expref: 7 pid: 6651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.298631:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787829923.298636:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787829923.298642:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3801099/0xc03b4d103c0d7dd5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c886c expref: 7 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.298687:0:6650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009863dc01/0xc03b4d103c0d7dce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8865 expref: 7 pid: 6651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.298703:0:6650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009863dc01/0xc03b4d103c0d7dce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8865 expref: 7 pid: 6651 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829923.298731:0:6650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3ce580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6650:1874675284114944:192.168.201.51@tcp:104: 00000100:00100000:3.0:1787829923.298855:0:6650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b81e32a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787829923.303414:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829923.306088:0:6650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3ce580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6650:1874675284114944:192.168.201.51@tcp:104: 00010000:00010000:3.0:1787829923.306139:0:6650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d3801099/0xc03b4d103c0d7dd5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c886c expref: 7 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.306167:0:6650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164fc00, rc 0) 00000100:00100000:3.0:1787829923.306274:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7489de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+7:10471:x1874675275703168:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 7754us (9058us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829923.306286:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 28 00000100:00100000:0.0:1787829923.308898:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275703296 00000100:00100000:0.0:1787829923.308918:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275703296 00010000:00010000:0.0:1787829923.308991:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009863dc01/0xc03b4d103c0d7dce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8865 expref: 7 pid: 6651 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829923.309067:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 42 00000100:00100000:0.0:1787829923.309079:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b51a04c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+7:2363:x1874675275703296:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787829923.309100:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829923.309130:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009863dc01/0xc03b4d103c0d7dce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8865 expref: 7 pid: 6651 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.309146:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009863dc01/0xc03b4d103c0d7dce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8865 expref: 7 pid: 6651 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.309193:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009863dc01/0xc03b4d103c0d7dce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8865 expref: 7 pid: 6651 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.309213:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787829923.309218:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787829923.309229:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3801099/0xc03b4d103c0d7dd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c886c expref: 6 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.309242:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3801099/0xc03b4d103c0d7dd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c886c expref: 6 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.309313:0:5792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d3801099/0xc03b4d103c0d7dd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c886c expref: 6 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829923.309333:0:5792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b42c88f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5792:1874675284115072:192.168.201.51@tcp:105: 00000100:00100000:0.0:1787829923.309440:0:5792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b510600c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787829923.331966:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829923.332342:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275703424 00000100:00100000:0.0:1787829923.332357:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275703424 00002000:00100000:0.0:1787829923.332439:0:6657:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9e9b7489d2c0 x1874675275703424/t0(0) o4->b6abf229-545c-43fd-8dee-d9adf582be48@192.168.201.51@tcp:504/0 lens 504/0 e 0 to 0 dl 1787829934 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787829923.332452:0:6657:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e9b7489d2c0 with x1874675275703424 ext(0->8) 00002000:00010000:0.0:1787829923.332460:0:6657:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e9b7489d2c0 00000100:00100000:0.0:1787829923.332513:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 0 00000100:00100000:0.0:1787829923.332530:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7489d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b6abf229-545c-43fd-8dee-d9adf582be48+7:2360:x1874675275703424:12345-192.168.201.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787829923.334844:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7489d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b6abf229-545c-43fd-8dee-d9adf582be48+9:2360:x1874675275703424:12345-192.168.201.51@tcp:4:lhsmtool_posix.0 Request processed in 2310us (2885us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787829923.334858:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 0 00002000:00100000:0.0:1787829923.334870:0:6657:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9e9b7489d2c0 x1874675275703424/t4294967302(0) o4->b6abf229-545c-43fd-8dee-d9adf582be48@192.168.201.51@tcp:504/0 lens 504/448 e 0 to 0 dl 1787829934 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787829923.334882:0:6657:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e9b7489d2c0 with x1874675275703424 ext(0->8) 00002000:00010000:0.0:1787829923.334888:0:6657:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e9b7489d2c0 00000100:00100000:1.0:1787829923.345298:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829923.345440:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275703552 00000100:00100000:2.0:1787829923.345449:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275703552 00000100:00100000:2.0:1787829923.345508:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 80 00000100:00100000:2.0:1787829923.345519:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7489c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+42:10471:x1874675275703552:12345-192.168.201.51@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787829923.346597:0:5792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b42c88f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5792:1874675284115072:192.168.201.51@tcp:105: 00010000:00010000:0.0:1787829923.346624:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829923.346702:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b51a04c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+8:2363:x1874675275703296:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 37624us (43303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829923.346721:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 42 00000040:00080000:3.0:1787829923.405145:0:11962:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787829923.405162:0:11962:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787829923.405214:0:11962:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787829923.405221:0:11962:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1787829923.426383:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:3.0:1787829923.426402:0:5827:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:2.0:1787829923.426649:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7489c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+41:10471:x1874675275703552:12345-192.168.201.51@tcp:44:lhsmtool_posix.0 Request processed in 81123us (81359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829923.426664:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 80 00000100:00100000:0.0:1787829923.427127:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787829923.427155:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b42c88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284115200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787829923.427243:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829923.427366:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284115200 00000100:00100000:2.0:1787829923.427377:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284115200 00000100:00100000:2.0:1787829923.427427:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787829923.427437:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b42c89680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284115200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787829923.427633:0:6651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787829923.427638:0:6651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787829923 00002000:00010000:2.0:1787829923.427641:0:6651:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787829923.427643:0:6651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787829923 -> 1787829923 00002000:00010000:2.0:1787829923.427647:0:6651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787829923.427729:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b42c89680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3279:x1874675284115200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 293us (487us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787829923.427737:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000020:00080000:3.0:1787829923.427800:0:5827:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:2.0:1787829923.427802:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e9b42c88f00/2, rc 0, transno 4294967303 00000100:00100000:2.0:1787829923.427811:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b42c88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284115200:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1787829923.427849:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:3.0:1787829923.427977:0:5838:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1787829923.427990:0:5838:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787829923.442821:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829923.443370:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275703680 00000100:00100000:1.0:1787829923.443387:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275703680 00000100:00100000:1.0:1787829923.443477:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 30 00000100:00100000:1.0:1787829923.443504:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+8:2361:x1874675275703680:12345-192.168.201.51@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1787829923.493138:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787829923.525968:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:2.0:1787829923.526000:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1787829923.526367:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+6:2361:x1874675275703680:12345-192.168.201.51@tcp:16:lhsmtool_posix.0 Request processed in 82861us (83548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829923.526379:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 30 00000100:00100000:3.0:1787829923.529171:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829923.529266:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275703936 00000100:00100000:1.0:1787829923.529278:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275703936 00000100:00100000:1.0:1787829923.529352:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 81 00000100:00100000:1.0:1787829923.529363:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+13:10471:x1874675275703936:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787829923.529422:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829923.529452:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7dc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c885e expref: 13 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.529474:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e9b48f25d00) 00010000:00010000:1.0:1787829923.529480:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787829923.529512:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d7ddc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.529526:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d7ddc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.529536:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d7ddc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787829923.529832:0:5805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000046ad41f0 reply state 00000000e11d5b5c transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d7ddc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829923.529843:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787829923.529950:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+14:10471:x1874675275703936:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 Request processed in 588us (787us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1787829923.529973:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 81 00010000:00010000:3.0:1787829923.532785:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d7ddc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.532812:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d7ddc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.532821:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d7ddc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.532830:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feefa00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829923.532837:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d7ddc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.532848:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d7ddc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.532894:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e9b48f25d00) 00010000:00010000:3.0:1787829923.532898:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829923.532904:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d7ddc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.532911:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d7ddc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829923.541726:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829923.542785:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275704064 00000100:00100000:0.0:1787829923.542801:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275704064 00000100:00100000:0.0:1787829923.542863:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 31 00000100:00100000:0.0:1787829923.542874:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:2363:x1874675275704064:12345-192.168.201.51@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787829923.543174:0:6652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787829923.543178:0:6652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787829923 -> 1787829922 00002000:00010000:0.0:1787829923.543181:0:6652:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787829921 00002000:00010000:0.0:1787829923.543183:0:6652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787829923 -> 1787829922 00002000:00010000:0.0:1787829923.543185:0:6652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787829923.543266:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+7:2363:x1874675275704064:12345-192.168.201.51@tcp:2:lhsmtool_posix.0 Request processed in 393us (1561us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787829923.543274:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 31 00000100:00100000:3.0:1787829923.554980:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829923.555073:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275704320 00000100:00100000:0.0:1787829923.555088:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275704320 00000100:00100000:0.0:1787829923.555160:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 82 00000100:00100000:0.0:1787829923.555176:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+13:10471:x1874675275704320:12345-192.168.201.51@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787829923.555249:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d7de3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.555268:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e800/0xc03b4d103c0d7da4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8850 expref: 13 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.555279:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d7de3 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.555314:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e800/0xc03b4d103c0d7da4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8850 expref: 13 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829923.555328:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e800/0xc03b4d103c0d7da4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8850 expref: 13 pid: 7257 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829923.555582:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b42c8a940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1874675284115328:192.168.201.51@tcp:104: 00000100:00100000:0.0:1787829923.555687:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51060e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787829923.558292:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b42c8a940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1874675284115328:192.168.201.51@tcp:104: 00010000:00010000:0.0:1787829923.558320:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d7de3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829923.559084:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829923.559168:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275704448 00000100:00100000:2.0:1787829923.559176:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275704448 00010000:00010000:2.0:1787829923.559213:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e800/0xc03b4d103c0d7da4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8850 expref: 14 pid: 7257 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829923.559252:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 43 00000100:00100000:2.0:1787829923.559261:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3ced00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+14:2363:x1874675275704448:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787829923.559274:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829923.559281:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e800/0xc03b4d103c0d7da4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8850 expref: 14 pid: 7257 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.559294:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e800/0xc03b4d103c0d7da4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8850 expref: 14 pid: 7257 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.559316:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e800/0xc03b4d103c0d7da4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8850 expref: 14 pid: 7257 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.559332:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e9b48f25d00) 00010000:00010000:2.0:1787829923.559347:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d7de3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.559357:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d7de3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.559364:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d7de3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.559400:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787829923.559440:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d7de3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.559453:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d7de3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829923.559464:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3ced00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+13:2363:x1874675275704448:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 198us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829923.559483:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 43 00010000:00010000:3.0:1787829923.559505:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d7de3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.559515:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d7de3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.559524:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d7de3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.559531:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7f000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829923.559536:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d7de3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.559545:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d7de3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.559572:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e9b48f25d00) 00010000:00010000:3.0:1787829923.559575:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787829923.559581:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d7de3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.559587:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d7de3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829923.559813:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+12:10471:x1874675275704320:12345-192.168.201.51@tcp:55:lhsmtool_posix.0 Request processed in 4641us (4846us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787829923.559822:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 82 00000100:00100000:3.0:1787829923.567616:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829923.567694:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275704576 00000100:00100000:2.0:1787829923.567717:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275704576 00000100:00100000:2.0:1787829923.567828:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 32 00000100:00100000:2.0:1787829923.567839:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+7:2363:x1874675275704576:12345-192.168.201.51@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787829923.567885:0:6650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f9379fc/0xc03b4d103c0d7dea lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.567906:0:6650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3801099/0xc03b4d103c0d7dd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c886c expref: 7 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.567915:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787829923.567919:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787829923.567924:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f9379fc/0xc03b4d103c0d7dea lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.567961:0:6650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d3801099/0xc03b4d103c0d7dd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.51@tcp remote: 0x53172783628c886c expref: 7 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.567975:0:6650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d3801099/0xc03b4d103c0d7dd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c886c expref: 7 pid: 6650 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829923.567992:0:6650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b596903c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6650:1874675284115456:192.168.201.51@tcp:104: 00000100:00100000:2.0:1787829923.568110:0:6650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51d40c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787829923.573277:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829923.575785:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275704704 00000100:00100000:1.0:1787829923.575802:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275704704 00010000:00010000:1.0:1787829923.575847:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d3801099/0xc03b4d103c0d7dd5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c886c expref: 8 pid: 6650 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829923.575904:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 44 00000100:00100000:1.0:1787829923.575916:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6abf229-545c-43fd-8dee-d9adf582be48+8:2363:x1874675275704704:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787829923.575933:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829923.575958:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d3801099/0xc03b4d103c0d7dd5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c886c expref: 8 pid: 6650 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.575973:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d3801099/0xc03b4d103c0d7dd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c886c expref: 8 pid: 6650 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.576001:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787829923.576006:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787829923.576013:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f9379fc/0xc03b4d103c0d7dea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.576060:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f9379fc/0xc03b4d103c0d7dea lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.576085:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829923.576158:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6abf229-545c-43fd-8dee-d9adf582be48+8:2363:x1874675275704704:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 243us (2888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829923.576177:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 44 00010000:00010000:2.0:1787829923.576318:0:6650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3801099/0xc03b4d103c0d7dd5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c886c expref: 7 pid: 6650 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829923.576339:0:6650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b596903c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6650:1874675284115456:192.168.201.51@tcp:104: 00010000:00010000:2.0:1787829923.576362:0:6650:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f9379fc/0xc03b4d103c0d7dea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.576372:0:6650:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f9379fc/0xc03b4d103c0d7dea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.576379:0:6650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f9379fc/0xc03b4d103c0d7dea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.576403:0:6650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f9379fc/0xc03b4d103c0d7dea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.576412:0:6650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f9379fc/0xc03b4d103c0d7dea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.576420:0:6650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f9379fc/0xc03b4d103c0d7dea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.576427:0:6650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f400 already unused, calling callback (ffffffffc1651420) 00010000:00010000:2.0:1787829923.576431:0:6650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f9379fc/0xc03b4d103c0d7dea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.576441:0:6650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f9379fc/0xc03b4d103c0d7dea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.576460:0:6650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f9379fc/0xc03b4d103c0d7dea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.576468:0:6650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f9379fc/0xc03b4d103c0d7dea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829923.576520:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+6:2363:x1874675275704576:12345-192.168.201.51@tcp:1:lhsmtool_posix.0 Request processed in 8682us (8928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829923.576528:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 32 00000100:00100000:3.0:1787829923.579754:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829923.579825:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275704960 00000100:00100000:2.0:1787829923.579838:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275704960 00000100:00100000:2.0:1787829923.579904:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 83 00000100:00100000:2.0:1787829923.579918:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+12:10471:x1874675275704960:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787829923.580003:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7df1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.580045:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7df1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.580059:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7df1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.580899:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7df8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.580925:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7db2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8857 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.580935:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7df8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.580987:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7db2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8857 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.581006:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7db2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8857 expref: 13 pid: 5805 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829923.581131:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3cd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1874675284115584:192.168.201.51@tcp:104: 00000100:00100000:3.0:1787829923.582209:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b81e32780 going to sleep for 11 seconds 00000100:00100000:3.0:1787829923.586326:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829923.586458:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275705088 00000100:00100000:1.0:1787829923.586472:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275705088 00010000:00010000:1.0:1787829923.586519:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7db2 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8857 expref: 14 pid: 5805 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829923.586574:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 45 00000100:00100000:1.0:1787829923.586583:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+14:2362:x1874675275705088:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787829923.586599:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829923.586606:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7db2 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8857 expref: 14 pid: 5805 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.586620:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7db2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8857 expref: 14 pid: 5805 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.586643:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e9b48f25d00) 00010000:00010000:1.0:1787829923.586648:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7df8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.586657:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7df8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.586666:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7df8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829923.586689:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829923.586760:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+14:2362:x1874675275705088:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 178us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829923.586778:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 45 00010000:00010000:2.0:1787829923.588054:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7db2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8857 expref: 13 pid: 5805 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829923.588077:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3cd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1874675284115584:192.168.201.51@tcp:104: 00010000:00010000:2.0:1787829923.588116:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7df8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.588128:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7df8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.588134:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7df8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787829923.588338:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1787829923.588520:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1787829923.588574:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1787829923.588679:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b596903c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5806:1874675284115712:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787829923.588752:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829923.588789:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47e28a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787829923.589577:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284115712 00000100:00100000:0.0:1787829923.589583:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284115712 00000100:00100000:0.0:1787829923.589641:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787829923.589651:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b59690f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5806:x1874675284115712:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787829923.589805:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b59690f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5806:x1874675284115712:12345-0@lo:1000:mdt00_002.0 Request processed in 154us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829923.589812:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787829923.590031:0:5806:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1787829923.590039:0:5806:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e9b42c88f00, transno 4294967303 00000100:00100000:2.0:1787829923.590056:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b596903c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5806:1874675284115712:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787829923.590798:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1787829923.590872:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b596903c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5806:1874675284115840:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787829923.590933:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829923.590960:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b7293c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787829923.592485:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284115840 00000100:00100000:2.0:1787829923.592496:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284115840 00000100:00100000:2.0:1787829923.592549:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787829923.592559:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b59693c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5806:x1874675284115840:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787829923.592826:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b59693c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5806:x1874675284115840:12345-0@lo:1000:mdt00_002.0 Request processed in 269us (1892us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787829923.592848:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787829923.592903:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b596903c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5806:1874675284115840:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787829923.592947:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7df8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.592958:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7df8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.592966:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7df8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.592973:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164e600 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829923.592979:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7df8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.592988:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7df8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.593003:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e9b48f25d00) 00010000:00010000:2.0:1787829923.593006:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787829923.593011:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7df8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.594315:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7df8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.594413:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d7d2d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.594421:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d7d2d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.594440:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d7d2d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.594446:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7ea00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829923.594450:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d7d2d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.594457:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d7d2d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.594471:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b48f25000) 00010000:00010000:2.0:1787829923.594475:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787829923.594478:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d7d2d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.594484:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d7d2d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.594508:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7dff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.594525:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7d49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c883b expref: 16 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.594535:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7dff lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.594574:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7d49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c883b expref: 16 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.594598:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7d49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c883b expref: 16 pid: 10044 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829923.594614:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b596921c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1874675284115968:192.168.201.51@tcp:104: 00000100:00100000:2.0:1787829923.596925:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b7293c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787829923.604572:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829923.604902:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b596921c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1874675284115968:192.168.201.51@tcp:104: 00010000:00010000:2.0:1787829923.604936:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7dff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829923.605345:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275705216 00000100:00100000:2.0:1787829923.605352:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275705216 00010000:00010000:2.0:1787829923.605389:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7d49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c883b expref: 17 pid: 10044 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829923.605425:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 46 00000100:00100000:2.0:1787829923.605435:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+17:2362:x1874675275705216:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787829923.605452:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829923.605459:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7d49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c883b expref: 17 pid: 10044 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.605473:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7d49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c883b expref: 17 pid: 10044 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.605501:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d7d49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c883b expref: 17 pid: 10044 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.605523:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b48f25000) 00010000:00010000:2.0:1787829923.605528:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7dff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.605537:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7dff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.605545:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7dff lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.605566:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787829923.605623:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+16:2362:x1874675275705216:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 188us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829923.605631:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 46 00010000:00010000:2.0:1787829923.605661:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7dff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.605668:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7dff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.605678:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7dff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.605683:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7dff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.605689:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7dff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.605694:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829923.605716:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7dff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.605724:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7dff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.605732:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b48f25000) 00010000:00010000:2.0:1787829923.605735:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829923.605738:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7dff lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.605744:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7dff lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.605754:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7df1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.605759:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7df1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.605764:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7df1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.605768:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f200 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829923.605770:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7df1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.605776:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7df1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.605780:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b48f25000) 00010000:00010000:2.0:1787829923.605782:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787829923.605790:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7df1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.605795:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7df1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829923.606000:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+15:10471:x1874675275704960:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 Request processed in 26087us (26261us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1787829923.606006:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 83 00000020:00080000:2.0:1787829923.606009:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787829923.610186:0:11648:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787829923.610197:0:11648:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787829923.610232:0:11648:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787829923.610238:0:11648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787829923.619572:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829923.619611:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275705472 00000100:00100000:2.0:1787829923.619621:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275705472 00000100:00100000:2.0:1787829923.619676:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 20 00000100:00100000:2.0:1787829923.619688:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+15:10471:x1874675275705472:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787829923.620382:0:5808:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787829923.620504:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1787829923.620550:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7e06 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.620567:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7e06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.620579:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7e06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.620586:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7e06 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.620593:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7e06 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.620609:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7e06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829923.620637:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787829923.621481:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+17:10471:x1874675275705472:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 Request processed in 1790us (1913us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1787829923.621491:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 20 00000020:00080000:2.0:1787829923.621496:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787829923.625633:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787829923.625648:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7e06 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.625660:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3e600 already unused, calling callback (ffffffffc1651420) 00010000:00010000:3.0:1787829923.625664:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7e06 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.625674:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7e06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.625693:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e9b45193100) 00010000:00010000:3.0:1787829923.625696:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787829923.625711:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7e06 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.625718:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7e06 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829923.625743:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829923.625746:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829923.625747:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829924.516268:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787829924.638718:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829924.638772:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829924.638848:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829924.638872:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829924.638922:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275705728 00000100:00100000:0.0:1787829924.638933:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275705728 00000100:00100000:0.0:1787829924.638993:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 138 00000100:00100000:0.0:1787829924.639004:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+17:2363:x1874675275705728:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787829924.639106:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+17:2363:x1874675275705728:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 104us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829924.639115:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 138 00000100:00100000:1.0:1787829924.639897:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275705600 00000100:00100000:1.0:1787829924.639904:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275705600 00000100:00100000:1.0:1787829924.639940:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 288 00000100:00100000:1.0:1787829924.639947:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2363:x1874675275705600:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829924.639990:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2363:x1874675275705600:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 43us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829924.639996:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 288 00000100:00100000:1.0:1787829924.641646:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829924.643621:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275706112 00000100:00100000:3.0:1787829924.643633:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275706112 00000100:00100000:3.0:1787829924.643710:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 139 00000100:00100000:3.0:1787829924.643723:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7489c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:902200d4-578b-4474-a651-ffe6603128fa+5:2363:x1874675275706112:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829924.643813:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7489c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:902200d4-578b-4474-a651-ffe6603128fa+5:2363:x1874675275706112:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 93us (2176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829924.643821:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 139 00000100:00080000:3.0:1787829924.643864:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787829924.645496:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275705984 00000100:00100000:2.0:1787829924.645506:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275705984 00000100:00080000:2.0:1787829924.646586:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787829924.650116:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275705856 00000100:00100000:0.0:1787829924.650130:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275705856 00000100:00100000:0.0:1787829924.650199:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 63 00000100:00100000:0.0:1787829924.650211:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+7:2363:x1874675275705984:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787829924.650307:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+7:2363:x1874675275705984:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 98us (11533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829924.650316:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 63 00000100:00100000:0.0:1787829924.650334:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 64 00000100:00100000:0.0:1787829924.650340:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:2363:x1874675275705856:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787829924.650366:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:2363:x1874675275705856:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 27us (11493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829924.650381:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 64 00000040:00080000:0.0:1787829925.431644:0:12014:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787829925.431659:0:12014:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787829925.431716:0:12014:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787829925.431723:0:12014:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787829925.539477:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829925.566735:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829925.566827:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275706368 00000100:00100000:2.0:1787829925.566841:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275706368 00000100:00100000:2.0:1787829925.566935:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 84 00000100:00100000:2.0:1787829925.566950:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b42c88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+17:10489:x1874675275706368:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:2.0:1787829925.566990:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829925.567046:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d7e0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8873 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.567430:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fe00/0xc03b4d103c0d7e14 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.567449:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fe00/0xc03b4d103c0d7e14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.567464:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fe00/0xc03b4d103c0d7e14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787829925.567489:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787829925.567711:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d7e0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8873 expref: 20 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.567734:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fe00/0xc03b4d103c0d7e14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8873 expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.567744:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:2.0:1787829925.567747:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787829925.567751:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3fe00, rc 0) 00000100:00100000:2.0:1787829925.567834:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b42c88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+19:10489:x1874675275706368:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 889us (1117us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1787829925.567844:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 84 00000100:00080000:3.0:1787829925.569796:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787829925.572344:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829925.572543:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275706496 00000100:00100000:0.0:1787829925.572557:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275706496 00000100:00100000:0.0:1787829925.572640:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 85 00000100:00100000:0.0:1787829925.572652:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+19:10489:x1874675275706496:12345-192.168.201.51@tcp:34:lfs.0 00010000:00010000:0.0:1787829925.572775:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e000/0xc03b4d103c0d7e22 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.572799:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e000/0xc03b4d103c0d7e22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.572816:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e000/0xc03b4d103c0d7e22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.572835:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d7e29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.572843:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d7e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.572851:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d7e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.573473:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d7e30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.573491:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d7e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.573500:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d7e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787829925.573556:0:10044:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d7e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.573572:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e000/0xc03b4d103c0d7e22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.573579:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e000/0xc03b4d103c0d7e22 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.573587:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e000/0xc03b4d103c0d7e22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.573593:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7e000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829925.573599:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e000/0xc03b4d103c0d7e22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.573608:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e000/0xc03b4d103c0d7e22 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.573747:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:0.0:1787829925.573751:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787829925.573757:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e000/0xc03b4d103c0d7e22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.573764:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e000/0xc03b4d103c0d7e22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.573786:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d7e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.573793:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d7e29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.573800:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d7e29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.573806:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7ea00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829925.573809:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d7e29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.573816:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d7e29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.573824:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e9b48f25800) 00010000:00010000:0.0:1787829925.573826:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787829925.573829:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d7e29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.573835:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d7e29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.573851:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d7e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.573857:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d7e30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.573862:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d7e30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.573874:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7e200 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829925.573877:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d7e30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.573884:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d7e30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.573892:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b48f25a00) 00010000:00010000:0.0:1787829925.573894:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787829925.573897:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d7e30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.573902:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d7e30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829925.574437:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+19:10489:x1874675275706496:12345-192.168.201.51@tcp:34:lfs.0 Request processed in 1781us (2102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829925.574460:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 85 00000100:00100000:3.0:1787829925.645156:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829925.645388:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275706752 00000100:00100000:3.0:1787829925.645400:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275706752 00000100:00100000:3.0:1787829925.645469:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 86 00000100:00100000:3.0:1787829925.645481:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+19:10492:x1874675275706752:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:3.0:1787829925.645510:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829925.645538:0:7257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7e37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c887a expref: -99 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.646392:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7e3e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.646414:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7e3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.646426:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7e3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.646443:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7e45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.646468:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7e45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.646476:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7e45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.647110:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7e4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.647122:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7e4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.647132:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7e4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829925.647144:0:7257:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787829925.648445:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7e3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.648459:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7e3e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.648467:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7e3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.648473:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164ec00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829925.648479:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7e3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.648487:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7e3e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.648518:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:3.0:1787829925.648521:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829925.648527:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7e3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.648534:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7e3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.648548:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7e45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.648555:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7e45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.648561:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7e45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.648566:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164e400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829925.648569:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7e45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.648576:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7e45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.648584:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e9b478cc300) 00010000:00010000:3.0:1787829925.648586:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829925.648588:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7e45 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.648593:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7e45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.648840:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7e37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c887a expref: 22 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.648858:0:7257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7e4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c887a expref: 21 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.648865:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b478cc700) 00010000:00010000:3.0:1787829925.648867:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787829925.648869:0:7257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164e600, rc 0) 00000100:00100000:3.0:1787829925.648963:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+21:10492:x1874675275706752:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 3482us (3818us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787829925.648973:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 86 00000100:00100000:3.0:1787829925.656758:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829925.656907:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275706880 00000100:00100000:0.0:1787829925.656920:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275706880 00000100:00100000:0.0:1787829925.656996:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 87 00000100:00100000:0.0:1787829925.657007:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52388b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+21:10492:x1874675275706880:12345-192.168.201.51@tcp:54:lfs.0 00010000:00010000:0.0:1787829925.657125:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d7e5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.657158:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d7e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.657170:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d7e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.657217:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d7e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.657224:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d7e5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.657232:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d7e5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.657239:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7e200 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829925.657245:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d7e5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.657260:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d7e5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.657273:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b478cc700) 00010000:00010000:0.0:1787829925.657276:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787829925.657282:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d7e5a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.657288:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d7e5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829925.657364:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52388b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+21:10492:x1874675275706880:12345-192.168.201.51@tcp:54:lfs.0 Request processed in 359us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829925.657371:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 87 00000100:00100000:1.0:1787829925.662776:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829925.662950:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275707136 00000100:00100000:3.0:1787829925.662963:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275707136 00000100:00100000:3.0:1787829925.663098:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 21 00000100:00100000:3.0:1787829925.663111:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b50360c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+21:10492:x1874675275707136:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:3.0:1787829925.663778:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b50360c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+22:10492:x1874675275707136:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 664us (1013us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1787829925.663788:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 21 00000100:00100000:3.0:1787829925.703552:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829925.703739:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275707392 00000100:00100000:0.0:1787829925.703753:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275707392 00000100:00100000:0.0:1787829925.703866:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 88 00000100:00100000:0.0:1787829925.703895:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5238ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+22:10012:x1874675275707392:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:0.0:1787829925.703932:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829925.703966:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d7e61 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8881 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829925.704470:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d7e68 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829925.704489:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7e4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c887a expref: 23 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829925.704501:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d7e68 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829925.704545:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7e4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c887a expref: 23 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829925.704562:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7e4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c887a expref: 23 pid: 7257 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829925.704591:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7489cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1874675284116096:192.168.201.51@tcp:104: 00000100:00100000:1.0:1787829925.704766:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b431ba840 going to sleep for 11 seconds 00000100:00100000:1.0:1787829925.707729:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7489cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1874675284116096:192.168.201.51@tcp:104: 00000100:00100000:3.0:1787829925.707762:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00010000:00010000:1.0:1787829925.707772:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d7e68 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829925.707876:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275707520 00000100:00100000:2.0:1787829925.707886:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275707520 00010000:00010000:2.0:1787829925.707938:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7e4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c887a expref: 24 pid: 7257 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829925.707986:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 47 00000100:00100000:2.0:1787829925.707996:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52388780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+24:2362:x1874675275707520:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787829925.708062:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829925.708071:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7e4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c887a expref: 24 pid: 7257 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.708085:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7e4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c887a expref: 24 pid: 7257 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.708137:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d7e4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c887a expref: 24 pid: 7257 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.708155:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b478cc700) 00010000:00010000:2.0:1787829925.708161:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d7e68 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.708173:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d7e68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.708190:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d7e68 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.708215:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787829925.708285:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52388780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+23:2362:x1874675275707520:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 290us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829925.708294:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 47 00010000:00010000:1.0:1787829925.708768:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d7e68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829925.708778:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d7e68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787829925.708802:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787829925.709490:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d7e61 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8881 expref: 24 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829925.709513:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d7e68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8881 expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829925.709521:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b478cc700) 00010000:00010000:1.0:1787829925.709524:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787829925.709527:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feee800, rc 0) 00000100:00100000:1.0:1787829925.709712:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5238ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+23:10012:x1874675275707392:12345-192.168.201.51@tcp:101:bash.0 Request processed in 5818us (6179us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787829925.709722:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 88 00000100:00100000:3.0:1787829925.712410:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829925.712962:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275707776 00000100:00100000:2.0:1787829925.712977:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275707776 00000100:00100000:2.0:1787829925.713113:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 89 00000100:00100000:2.0:1787829925.713123:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5238b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+23:10012:x1874675275707776:12345-192.168.201.51@tcp:36:bash.0 00010000:00010000:2.0:1787829925.713448:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d7e76 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.713471:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d7e76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.713487:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d7e76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787829925.713571:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1787829925.713597:0:5806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4b84483 reply state 0000000005eb583a transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d7e76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829925.713607:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787829925.713675:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1787829925.713800:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5238b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+27:10012:x1874675275707776:12345-192.168.201.51@tcp:36:bash.0 Request processed in 678us (1407us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1787829925.713807:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 89 00000020:00080000:2.0:1787829925.713811:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1787829925.715839:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d7e76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.715862:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d7e76 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.715872:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d7e76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.715879:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3e000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829925.715885:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d7e76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.715894:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d7e76 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.715918:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b478cc700) 00010000:00010000:0.0:1787829925.715922:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787829925.715929:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d7e76 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.715936:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d7e76 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829925.716706:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829925.716791:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275707904 00000100:00100000:0.0:1787829925.716804:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275707904 00000100:00100000:0.0:1787829925.716896:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 90 00000100:00100000:0.0:1787829925.716907:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52389e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+26:10012:x1874675275707904:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:0.0:1787829925.716939:0:10044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829925.716964:0:10044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e000/0xc03b4d103c0d7e7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8888 expref: -99 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.717079:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e000/0xc03b4d103c0d7e7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8888 expref: 27 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.717094:0:10044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e000/0xc03b4d103c0d7e7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8888 expref: 27 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.717117:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b478cc700) 00010000:00010000:0.0:1787829925.717121:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787829925.717124:0:10044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7fa7e000, rc 0) 00000100:00100000:0.0:1787829925.717449:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52389e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+27:10012:x1874675275707904:12345-192.168.201.51@tcp:101:bash.0 Request processed in 542us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829925.717458:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 90 00000100:00100000:3.0:1787829925.721739:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829925.722106:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275708032 00000100:00100000:1.0:1787829925.722126:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275708032 00000100:00100000:1.0:1787829925.722217:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 33 00000100:00080000:3.0:1787829925.722222:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787829925.722421:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b523892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:10012:x1874675275708032:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:1.0:1787829925.722448:0:6652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829925.722483:0:6652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062d2d37a/0xc03b4d103c0d7e84 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c888f expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787829925.722519:0:6652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a901ea2, atime: 0x6a901ea1, ctime: 0x6a901ea2, blocks: 0xb 00010000:00010000:1.0:1787829925.722548:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=305s v=(0 0) 00010000:00010000:1.0:1787829925.722553:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787829925.722564:0:6652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062d2d37a/0xc03b4d103c0d7e84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.51@tcp remote: 0x53172783628c888f expref: 7 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829925.722585:0:6652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000062d2d37a/0xc03b4d103c0d7e84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.51@tcp remote: 0x53172783628c888f expref: 7 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829925.722600:0:6652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feee200, rc 0) 00000100:00100000:1.0:1787829925.722689:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b523892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+7:10012:x1874675275708032:12345-192.168.201.51@tcp:101:bash.0 Request processed in 463us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829925.722698:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 33 00000100:00100000:0.0:1787829925.728312:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829925.728408:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275708160 00000100:00100000:1.0:1787829925.728422:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275708160 00002000:00010000:1.0:1787829925.728485:0:6655:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1787829925.728490:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e9b42c8a940 with x1874675275708160 ext(0->18446744073709551615) 00002000:00010000:1.0:1787829925.728506:0:6655:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e9b42c8a940. 00000100:00100000:1.0:1787829925.728573:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 1 00000100:00100000:1.0:1787829925.728586:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b42c8a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b6abf229-545c-43fd-8dee-d9adf582be48+7:2360:x1874675275708160:12345-192.168.201.51@tcp:10:bash.0 00002000:00010000:1.0:1787829925.728996:0:6655:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787829925.729001:0:6655:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787829922 -> 1787829926 00002000:00010000:1.0:1787829925.729004:0:6655:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787829921 -> 1787829921 00002000:00010000:1.0:1787829925.729006:0:6655:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787829922 -> 1787829926 00002000:00010000:1.0:1787829925.729009:0:6655:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787829925.729123:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b42c8a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b6abf229-545c-43fd-8dee-d9adf582be48+8:2360:x1874675275708160:12345-192.168.201.51@tcp:10:bash.0 Request processed in 538us (825us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787829925.729132:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 1 00002000:00010000:1.0:1787829925.729141:0:6655:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1787829925.729144:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e9b42c8a940 with x1874675275708160 ext(0->18446744073709551615) 00002000:00010000:1.0:1787829925.729153:0:6655:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e9b42c8a940. 00000001:00080000:3.0:1787829925.814862:0:7602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:3.0:1787829925.814890:0:7602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:3.0:1787829925.814904:0:7602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:2.0:1787829925.825575:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829925.825711:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275708288 00000100:00100000:1.0:1787829925.825726:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275708288 00000100:00100000:1.0:1787829925.825806:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 91 00000100:00100000:1.0:1787829925.825820:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+27:10506:x1874675275708288:12345-192.168.201.51@tcp:34:lfs.0 00010000:00010000:1.0:1787829925.825924:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7e8b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829925.825947:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7e8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829925.825963:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7e8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829925.825981:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d7e92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829925.825989:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d7e92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829925.826059:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d7e92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.826785:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7e99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.826798:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.826806:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787829925.826861:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.826877:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7e8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.826885:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7e8b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.826893:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7e8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.826913:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feefc00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829925.826919:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7e8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.826928:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7e8b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.826943:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:2.0:1787829925.826947:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829925.826952:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7e8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.826960:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7e8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.826974:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d7e92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.826981:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d7e92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.826987:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d7e92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.826993:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feeea00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829925.826996:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d7e92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.827001:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d7e92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.827078:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e9b507a7d00) 00010000:00010000:2.0:1787829925.827080:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829925.827084:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d7e92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.827091:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d7e92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.827108:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.827115:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7e99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.827121:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7e99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.827126:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3fa00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829925.827129:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7e99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.827135:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7e99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.827143:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b478cc700) 00010000:00010000:2.0:1787829925.827145:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829925.827149:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7e99 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.827154:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7e99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829925.827742:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+27:10506:x1874675275708288:12345-192.168.201.51@tcp:34:lfs.0 Request processed in 1917us (2174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829925.827755:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 91 00000100:00100000:3.0:1787829925.895233:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829925.895553:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275708544 00000100:00100000:1.0:1787829925.895568:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275708544 00000100:00100000:1.0:1787829925.895648:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 92 00000100:00100000:1.0:1787829925.895670:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b523883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+27:10509:x1874675275708544:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:1.0:1787829925.895698:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829925.895729:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d7ea0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8896 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829925.895838:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7ea7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829925.895857:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7ea7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829925.895871:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7ea7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829925.895889:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7eae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829925.895897:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829925.895903:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.896941:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7eb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.896955:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.896964:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787829925.896977:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787829925.897225:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7ea7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.897234:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7ea7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.897242:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.897248:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feefc00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829925.897254:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.897262:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7ea7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.897277:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:2.0:1787829925.897289:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829925.897295:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7ea7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.897302:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d7ea7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.897319:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.897326:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7eae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.897332:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7eae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.897337:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feeec00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829925.897340:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7eae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.897346:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7eae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.897354:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e9b507a7000) 00010000:00010000:2.0:1787829925.897357:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829925.897360:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7eae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.897365:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d7eae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.897428:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d7ea0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8896 expref: 30 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.897460:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8896 expref: 29 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.897468:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b478cc700) 00010000:00010000:2.0:1787829925.897471:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787829925.897474:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3fa00, rc 0) 00000100:00100000:2.0:1787829925.897572:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b523883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+29:10509:x1874675275708544:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 1912us (2354us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1787829925.897583:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 92 00000100:00100000:0.0:1787829925.905313:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829925.905421:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275708672 00000100:00100000:3.0:1787829925.905434:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275708672 00000100:00100000:3.0:1787829925.905517:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 93 00000100:00100000:3.0:1787829925.905530:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b42c8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+29:10509:x1874675275708672:12345-192.168.201.51@tcp:54:lfs.0 00010000:00010000:3.0:1787829925.905625:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7ec3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.905646:0:10044:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d7e68 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8881 expref: 29 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.905657:0:10044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7ec3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.905711:0:10044:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d7e68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8881 expref: 29 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829925.905728:0:10044:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d7e68 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8881 expref: 29 pid: 5804 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829925.905748:0:10044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b52388000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10044:1874675284116224:192.168.201.51@tcp:104: 00000100:00100000:3.0:1787829925.905882:0:10044:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b44d20c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787829925.915653:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829925.915986:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275708928 00000100:00100000:1.0:1787829925.916050:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275708928 00000100:00100000:1.0:1787829925.916128:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 22 00000100:00100000:1.0:1787829925.916139:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52388f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+30:5599:x1874675275708928:12345-192.168.201.51@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787829925.916564:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52388f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+31:5599:x1874675275708928:12345-192.168.201.51@tcp:35:ldlm_bl.0 Request processed in 416us (916us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1787829925.916573:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 22 00000100:00100000:0.0:1787829925.918271:0:10044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b52388000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10044:1874675284116224:192.168.201.51@tcp:104: 00010000:00010000:0.0:1787829925.918312:0:10044:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7ec3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829925.927774:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829925.928101:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275709056 00000100:00100000:2.0:1787829925.928114:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275709056 00010000:00010000:2.0:1787829925.928167:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d7e68 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8881 expref: 31 pid: 5804 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829925.928218:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 48 00000100:00100000:2.0:1787829925.928230:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52389680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+31:2362:x1874675275709056:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787829925.928251:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829925.928260:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d7e68 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8881 expref: 31 pid: 5804 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.928275:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d7e68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8881 expref: 31 pid: 5804 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.928303:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d7e68 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8881 expref: 31 pid: 5804 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.928348:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b478cc700) 00010000:00010000:2.0:1787829925.928355:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7ec3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.928366:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.928375:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7ec3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829925.928418:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787829925.928488:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52389680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+30:2362:x1874675275709056:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 259us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829925.928496:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 48 00010000:00010000:0.0:1787829925.928544:0:10044:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.928555:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.928622:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.928630:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7ec3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.928637:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.928645:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164e200 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829925.928650:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.928658:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7ec3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.928677:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b478cc700) 00010000:00010000:0.0:1787829925.928680:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787829925.928684:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7ec3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829925.928690:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7ec3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829925.928741:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b42c8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+29:10509:x1874675275708672:12345-192.168.201.51@tcp:54:lfs.0 Request processed in 23212us (23441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829925.928751:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 93 00000100:00100000:3.0:1787829925.932962:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829925.937810:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275709312 00000100:00100000:2.0:1787829925.937834:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275709312 00000100:00100000:2.0:1787829925.937930:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 23 00000100:00100000:2.0:1787829925.937943:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5238a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+29:10509:x1874675275709312:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:2.0:1787829925.938333:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5238a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+30:10509:x1874675275709312:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 390us (5384us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1787829925.938342:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 23 00000100:00100000:3.0:1787829926.031536:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829926.031729:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275709568 00000100:00100000:2.0:1787829926.031743:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275709568 00000100:00100000:2.0:1787829926.031821:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 94 00000100:00100000:2.0:1787829926.031833:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5238b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+30:10520:x1874675275709568:12345-192.168.201.51@tcp:101:cat.0 00010000:00010000:2.0:1787829926.031867:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829926.031906:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7eca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c889d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.032065:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7ed1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.032084:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7ed1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.032097:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7ed1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.032114:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7ed8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.032121:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.032127:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.032575:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7edf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.032587:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7edf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.032595:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7edf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787829926.032607:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787829926.032765:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7ed1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.032785:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7ed1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.032793:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7ed1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.032800:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f600 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829926.032805:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7ed1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.032814:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7ed1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.032829:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:2.0:1787829926.032832:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829926.032838:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7ed1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.032845:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7ed1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.032861:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.032867:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7ed8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.032872:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.032877:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3e800 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829926.032887:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.032893:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7ed8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.032901:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e9b45193e00) 00010000:00010000:2.0:1787829926.032904:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829926.032907:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7ed8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.032912:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7ed8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.032968:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7eca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c889d expref: 33 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.032983:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7edf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c889d expref: 32 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.032990:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b478cc700) 00010000:00010000:2.0:1787829926.032992:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787829926.032995:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3ec00, rc 0) 00000100:00100000:2.0:1787829926.033143:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5238b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+32:10520:x1874675275709568:12345-192.168.201.51@tcp:101:cat.0 Request processed in 1311us (1622us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1787829926.033153:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 94 00000100:00100000:3.0:1787829926.039748:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829926.040126:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275709824 00000100:00100000:2.0:1787829926.040141:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275709824 00000100:00100000:2.0:1787829926.040226:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 24 00000100:00100000:2.0:1787829926.040238:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5238bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+32:10520:x1874675275709824:12345-192.168.201.51@tcp:35:cat.0 00000100:00100000:2.0:1787829926.040582:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5238bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+33:10520:x1874675275709824:12345-192.168.201.51@tcp:35:cat.0 Request processed in 346us (850us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1787829926.040592:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 24 00000100:00100000:3.0:1787829926.065078:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829926.065224:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275710080 00000100:00100000:2.0:1787829926.065235:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275710080 00000100:00100000:2.0:1787829926.065313:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 95 00000100:00100000:2.0:1787829926.065324:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5238a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+33:10521:x1874675275710080:12345-192.168.201.51@tcp:36:rm.0 00010000:00010000:2.0:1787829926.065395:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787829926.065430:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7edf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c889d expref: 33 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.065455:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d7eb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8896 expref: 32 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.065469:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e000/0xc03b4d103c0d7e7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8888 expref: 31 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.065480:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b478cc700) 00010000:00010000:2.0:1787829926.065492:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787829926.065516:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7eed lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.065532:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7eed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.065542:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7eed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.065578:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7ef4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.065586:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7ef4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.065593:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7ef4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.065920:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7efb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.065929:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7efb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.065935:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7efb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787829926.066646:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1787829926.066656:0:5805:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 305967638419ns, next at 306967635182ns, rc = 0 00010000:00010000:2.0:1787829926.066749:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7f02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.066761:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7f02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.066772:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7f02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.066780:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7f02 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.066798:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7f02 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.066805:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7f02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.066835:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787829926.066861:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7efb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.066866:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7efb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.066873:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7efb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.066879:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f600 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829926.066884:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7efb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.066892:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7efb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.066905:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b45193600) 00010000:00010000:2.0:1787829926.066908:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787829926.066913:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7efb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.066920:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d7efb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.066940:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7eed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.066952:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7eed lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.066958:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7eed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.066965:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f800 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829926.066968:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7eed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.066975:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7eed lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.066984:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:2.0:1787829926.066987:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829926.066990:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7eed lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.066995:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d7eed lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787829926.067006:0:5805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009319d672 reply state 0000000002c5f2cb transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7ef4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829926.067045:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787829926.067165:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5238a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+32:10521:x1874675275710080:12345-192.168.201.51@tcp:36:rm.0 Request processed in 1837us (2097us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787829926.067174:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 95 00010000:00010000:0.0:1787829926.067353:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787829926.067363:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7f02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.067382:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3ea00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787829926.067385:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7f02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.067391:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7f02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.067401:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e9b45193600) 00010000:00010000:0.0:1787829926.067403:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787829926.067406:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7f02 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.067411:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d7f02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.067426:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829926.067428:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829926.067430:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829926.068864:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7ef4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.068882:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7ef4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.068890:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7ef4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.068897:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3e800 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829926.068902:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7ef4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.068910:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7ef4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.068926:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e9b45193e00) 00010000:00010000:1.0:1787829926.068928:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829926.068933:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7ef4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.068939:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d7ef4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829926.100755:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829926.101424:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275710336 00000100:00100000:0.0:1787829926.101439:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275710336 00000100:00100000:0.0:1787829926.101525:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 96 00000100:00100000:0.0:1787829926.101538:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5238a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+31:10527:x1874675275710336:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:0.0:1787829926.101571:0:10044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829926.101598:0:10044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e800/0xc03b4d103c0d7f09 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c88a4 expref: -99 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.101791:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d7f10 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.101834:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d7f10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.101850:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d7f10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.101869:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7f17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.101877:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7f17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.101883:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7f17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787829926.104094:0:10044:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1787829926.104555:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7f1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.104577:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.104591:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.104637:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d7f10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.104645:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d7f10 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.104653:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d7f10 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.104672:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7fc00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829926.104678:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d7f10 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.104687:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d7f10 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.104702:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:1.0:1787829926.104705:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829926.104711:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d7f10 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.104718:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d7f10 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787829926.104748:0:10044:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aae7f13d reply state 000000003ef979fc transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7f17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829926.104759:0:10044:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787829926.104804:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e800/0xc03b4d103c0d7f09 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88a4 expref: 34 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.104822:0:10044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88a4 expref: 33 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.104830:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b507a7000) 00010000:00010000:1.0:1787829926.104833:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787829926.104835:0:10044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feef000, rc 0) 00000100:00100000:1.0:1787829926.104940:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5238a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+34:10527:x1874675275710336:12345-192.168.201.51@tcp:101:bash.0 Request processed in 3404us (4200us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1787829926.105682:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 96 00000100:00100000:3.0:1787829926.109860:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00010000:00010000:1.0:1787829926.109957:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7f17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.109972:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7f17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.109981:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7f17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.109987:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7f400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829926.109993:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7f17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.110048:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7f17 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.110069:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e9b48f25100) 00010000:00010000:1.0:1787829926.110072:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829926.110078:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7f17 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.110085:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d7f17 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829926.110272:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275710464 00000100:00100000:2.0:1787829926.110285:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275710464 00000100:00100000:2.0:1787829926.110370:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 34 00000100:00100000:2.0:1787829926.110383:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52389a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+5:2362:x1874675275710464:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:2.0:1787829926.110407:0:6650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829926.110430:0:6650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c617c198/0xc03b4d103c0d7f2c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c88ab expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787829926.110464:0:6650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787829926.110486:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=306s v=(0 0) 00010000:00010000:2.0:1787829926.110490:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787829926.110501:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c617c198/0xc03b4d103c0d7f2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88ab expref: 6 pid: 6650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.110521:0:6650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c617c198/0xc03b4d103c0d7f2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88ab expref: 6 pid: 6650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.110535:0:6650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3f800, rc 0) 00000100:00100000:2.0:1787829926.110601:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52389a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+6:2362:x1874675275710464:12345-192.168.201.51@tcp:101:bash.0 Request processed in 222us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829926.110610:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 34 00000100:00080000:1.0:1787829926.110690:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787829926.117911:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829926.118363:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275710592 00000100:00100000:2.0:1787829926.118378:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275710592 00000100:00100000:2.0:1787829926.118466:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 35 00000100:00100000:2.0:1787829926.118926:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5238b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+6:10527:x1874675275710592:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:2.0:1787829926.118955:0:8603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829926.118983:0:8603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d7f33 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c88b2 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.119113:0:8603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c617c198/0xc03b4d103c0d7f2c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88ab expref: 7 pid: 6650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.119125:0:8603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787829926.119130:0:8603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787829926.119137:0:8603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d7f33 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88b2 expref: 7 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.119186:0:8603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c617c198/0xc03b4d103c0d7f2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88ab expref: 7 pid: 6650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.119203:0:8603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c617c198/0xc03b4d103c0d7f2c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88ab expref: 7 pid: 6650 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829926.119222:0:8603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8603:1874675284116352:192.168.201.51@tcp:104: 00000100:00100000:2.0:1787829926.119704:0:8603:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b7293cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787829926.124403:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829926.124694:0:8603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8603:1874675284116352:192.168.201.51@tcp:104: 00010000:00010000:2.0:1787829926.124746:0:8603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d7f33 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c88b2 expref: 7 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.124774:0:8603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3f600, rc 0) 00000100:00100000:1.0:1787829926.124860:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275710720 00000100:00100000:1.0:1787829926.124870:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275710720 00000100:00100000:2.0:1787829926.124888:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5238b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+8:10527:x1874675275710592:12345-192.168.201.51@tcp:101:bash.0 Request processed in 6413us (6993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829926.124900:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 35 00010000:00010000:1.0:1787829926.124916:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c617c198/0xc03b4d103c0d7f2c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88ab expref: 8 pid: 6650 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829926.124954:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 49 00000100:00100000:1.0:1787829926.124964:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b51a04450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+7:2363:x1874675275710720:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787829926.124981:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829926.125014:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c617c198/0xc03b4d103c0d7f2c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88ab expref: 7 pid: 6650 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.125066:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c617c198/0xc03b4d103c0d7f2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88ab expref: 7 pid: 6650 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.125096:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c617c198/0xc03b4d103c0d7f2c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88ab expref: 7 pid: 6650 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.125120:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787829926.125125:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787829926.125135:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d7f33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c88b2 expref: 6 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.125147:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d7f33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c88b2 expref: 6 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.125184:0:5790:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d7f33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c88b2 expref: 6 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829926.125198:0:5790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7489cf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5790:1874675284116480:192.168.201.51@tcp:105: 00000100:00100000:1.0:1787829926.125398:0:5790:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b81e32d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787829926.141792:0:5790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7489cf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5790:1874675284116480:192.168.201.51@tcp:105: 00010000:00010000:1.0:1787829926.141835:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829926.141912:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b51a04450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+6:2363:x1874675275710720:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 16947us (17522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829926.141925:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 49 00000100:00100000:1.0:1787829926.142620:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829926.142704:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275710976 00000100:00100000:2.0:1787829926.142714:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275710976 00000100:00100000:2.0:1787829926.142785:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 25 00000100:00100000:2.0:1787829926.142797:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7489cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+33:10527:x1874675275710976:12345-192.168.201.51@tcp:35:bash.0 00000100:00100000:2.0:1787829926.143343:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7489cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+34:10527:x1874675275710976:12345-192.168.201.51@tcp:35:bash.0 Request processed in 544us (723us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787829926.143353:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 25 00000100:00100000:3.0:1787829926.285940:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829926.286325:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275711104 00000100:00100000:2.0:1787829926.286338:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275711104 00000100:00100000:2.0:1787829926.286452:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 97 00000100:00100000:2.0:1787829926.286465:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52388780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+34:10543:x1874675275711104:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:2.0:1787829926.286500:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829926.286529:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7f3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c88b9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.286620:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7f41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.286639:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7f41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.286663:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7f41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787829926.286749:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787829926.286754:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787829926.286781:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7f41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.286810:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7f3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88b9 expref: 36 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.286850:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7f41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88b9 expref: 35 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.286859:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:2.0:1787829926.286862:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787829926.286865:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3f400, rc 0) 00000100:00100000:2.0:1787829926.286947:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52388780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+35:10543:x1874675275711104:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 484us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829926.287073:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 97 00000100:00100000:0.0:1787829926.293897:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829926.293995:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275711360 00000100:00100000:2.0:1787829926.294010:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275711360 00000100:00100000:2.0:1787829926.294121:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 98 00000100:00100000:2.0:1787829926.294135:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b42c8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+35:10543:x1874675275711360:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:2.0:1787829926.294164:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829926.294192:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7f48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c88c0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.294332:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7f4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.294347:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7f4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.294357:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7f4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787829926.294367:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787829926.294549:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7f48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88c0 expref: 38 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.294575:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7f4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88c0 expref: 37 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.294583:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b507a7000) 00010000:00010000:2.0:1787829926.294585:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787829926.294588:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3f200, rc 0) 00000100:00100000:2.0:1787829926.294673:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b42c8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+37:10543:x1874675275711360:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 541us (789us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1787829926.294682:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 98 00000100:00100000:1.0:1787829926.299410:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829926.299524:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829926.299607:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275711744 00000100:00100000:2.0:1787829926.299620:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275711744 00000100:00100000:2.0:1787829926.299716:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 6 00000100:00100000:2.0:1787829926.299728:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7489e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+37:2360:x1874675275711744:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787829926.299749:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829926.299786:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f200/0xc03b4d103c0d7f4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88c0 expref: 37 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.299809:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b507a7000) 00010000:00010000:2.0:1787829926.299817:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787829926.299897:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7489e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+36:2360:x1874675275711744:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 170us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829926.299905:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 6 00000100:00100000:3.0:1787829926.301404:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275711616 00000100:00100000:3.0:1787829926.301418:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275711616 00000100:00100000:3.0:1787829926.301542:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 99 00000100:00100000:3.0:1787829926.301554:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7489d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+36:10543:x1874675275711616:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:3.0:1787829926.301585:0:10044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829926.301612:0:10044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7f5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c88c7 expref: -99 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829926.301754:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7f64 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829926.301772:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7f64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829926.301787:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7f64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829926.301803:0:10044:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787829926.301988:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7f5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88c7 expref: 39 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829926.302012:0:10044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7f64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88c7 expref: 38 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829926.302073:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b507a7000) 00010000:00010000:3.0:1787829926.302076:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787829926.302081:0:10044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164fc00, rc 0) 00000100:00100000:3.0:1787829926.302160:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7489d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+38:10543:x1874675275711616:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 608us (2765us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1787829926.302167:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 99 00000100:00100000:1.0:1787829926.307938:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829926.308059:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275711872 00000100:00100000:2.0:1787829926.308073:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275711872 00000100:00100000:2.0:1787829926.308169:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 36 00000100:00100000:2.0:1787829926.308180:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7489f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+6:2363:x1874675275711872:12345-192.168.201.51@tcp:1:lfs.0 00010000:00010000:2.0:1787829926.308259:0:6650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035f87f2e/0xc03b4d103c0d7f72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.308285:0:6650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d7f33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c88b2 expref: 6 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.308295:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787829926.308300:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787829926.308306:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035f87f2e/0xc03b4d103c0d7f72 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.308353:0:6650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d7f33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.51@tcp remote: 0x53172783628c88b2 expref: 6 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.308370:0:6650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d7f33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c88b2 expref: 6 pid: 8603 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829926.308389:0:6650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6650:1874675284116608:192.168.201.51@tcp:104: 00000100:00100000:2.0:1787829926.308513:0:6650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b7293c240 going to sleep for 11 seconds 00000100:00100000:0.0:1787829926.312188:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829926.312414:0:6650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6650:1874675284116608:192.168.201.51@tcp:104: 00010000:00010000:2.0:1787829926.312453:0:6650:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000035f87f2e/0xc03b4d103c0d7f72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829926.312704:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275712000 00000100:00100000:1.0:1787829926.312714:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275712000 00002000:00100000:1.0:1787829926.312799:0:6657:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9e9b42c8a1c0 x1874675275712000/t0(0) o4->b6abf229-545c-43fd-8dee-d9adf582be48@192.168.201.51@tcp:507/0 lens 504/0 e 0 to 0 dl 1787829937 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787829926.312810:0:6657:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e9b42c8a1c0 with x1874675275712000 ext(0->8) 00010000:00010000:1.0:1787829926.312818:0:6657:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d7f33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c88b2 expref: 7 pid: 8603 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.312835:0:6657:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d7f33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c88b2 expref: 7 pid: 8603 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787829926.312843:0:6657:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e9b42c8a1c0 00000100:00100000:1.0:1787829926.312880:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 1 00000100:00100000:1.0:1787829926.312891:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b42c8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b6abf229-545c-43fd-8dee-d9adf582be48+7:2362:x1874675275712000:12345-192.168.201.51@tcp:4:lfs.0 00000100:00100000:1.0:1787829926.313983:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b42c8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b6abf229-545c-43fd-8dee-d9adf582be48+9:2362:x1874675275712000:12345-192.168.201.51@tcp:4:lfs.0 Request processed in 1085us (1800us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787829926.313995:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 1 00002000:00100000:1.0:1787829926.314005:0:6657:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9e9b42c8a1c0 x1874675275712000/t4294967302(0) o4->b6abf229-545c-43fd-8dee-d9adf582be48@192.168.201.51@tcp:507/0 lens 504/448 e 0 to 0 dl 1787829937 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787829926.314053:0:6657:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e9b42c8a1c0 with x1874675275712000 ext(0->8) 00010000:00010000:1.0:1787829926.314063:0:6657:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d7f33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c88b2 expref: 9 pid: 8603 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.314080:0:6657:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d7f33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c88b2 expref: 9 pid: 8603 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787829926.314087:0:6657:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e9b42c8a1c0 00000100:00100000:3.0:1787829926.317095:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829926.317317:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275712128 00000100:00100000:0.0:1787829926.317332:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275712128 00010000:00010000:0.0:1787829926.317389:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d7f33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c88b2 expref: 9 pid: 8603 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829926.317492:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 50 00000100:00100000:0.0:1787829926.317505:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52389680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+9:2362:x1874675275712128:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787829926.317527:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787829926.317554:0:8409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787829926.317557:0:8409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787829926 00002000:00010000:0.0:1787829926.317560:0:8409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787829926 00002000:00010000:0.0:1787829926.317582:0:8409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787829926 00010000:00010000:0.0:1787829926.317591:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d7f33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c88b2 expref: 9 pid: 8603 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.317607:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d7f33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c88b2 expref: 9 pid: 8603 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.317637:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d7f33 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c88b2 expref: 9 pid: 8603 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.317669:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787829926.317674:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787829926.317681:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000035f87f2e/0xc03b4d103c0d7f72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.317694:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035f87f2e/0xc03b4d103c0d7f72 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.317732:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829926.317804:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52389680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+8:2362:x1874675275712128:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 302us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829926.317812:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 50 00010000:00010000:2.0:1787829926.317878:0:6650:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000035f87f2e/0xc03b4d103c0d7f72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.317896:0:6650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035f87f2e/0xc03b4d103c0d7f72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.317927:0:6650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035f87f2e/0xc03b4d103c0d7f72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.317936:0:6650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035f87f2e/0xc03b4d103c0d7f72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.317945:0:6650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035f87f2e/0xc03b4d103c0d7f72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.317964:0:6650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3ec00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:2.0:1787829926.317969:0:6650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035f87f2e/0xc03b4d103c0d7f72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.317979:0:6650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035f87f2e/0xc03b4d103c0d7f72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.317993:0:6650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035f87f2e/0xc03b4d103c0d7f72 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.318002:0:6650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035f87f2e/0xc03b4d103c0d7f72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829926.318106:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7489f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+7:2363:x1874675275711872:12345-192.168.201.51@tcp:1:lfs.0 Request processed in 9928us (10182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829926.318116:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 36 00000100:00100000:2.0:1787829926.320631:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829926.320727:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275712384 00000100:00100000:3.0:1787829926.320740:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275712384 00000100:00100000:3.0:1787829926.320816:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 26 00000100:00100000:3.0:1787829926.320828:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b50360450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+38:10543:x1874675275712384:12345-192.168.201.51@tcp:35:lfs.0 00000004:00010000:3.0:1787829926.320914:0:5808:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7f64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88c7 expref: 38 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787829926.321295:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1787829926.321349:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1787829926.321754:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1787829926.321814:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7f79 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829926.321833:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7f1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88a4 expref: 42 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829926.321843:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7f79 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829926.321892:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88a4 expref: 42 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829926.321931:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7f1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88a4 expref: 42 pid: 10044 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829926.321948:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b52388000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5808:1874675284116736:192.168.201.51@tcp:104: 00000100:00100000:3.0:1787829926.322088:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b44d209c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787829926.327724:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b52388000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5808:1874675284116736:192.168.201.51@tcp:104: 00010000:00010000:1.0:1787829926.327770:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7f79 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829926.328629:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829926.328734:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275712512 00000100:00100000:1.0:1787829926.328744:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275712512 00010000:00010000:1.0:1787829926.328793:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7f1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88a4 expref: 43 pid: 10044 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829926.328842:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 51 00000100:00100000:1.0:1787829926.328852:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52388000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+43:2363:x1874675275712512:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787829926.328871:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829926.328878:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7f1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88a4 expref: 43 pid: 10044 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.328893:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88a4 expref: 43 pid: 10044 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.328922:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d7f1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88a4 expref: 43 pid: 10044 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.328941:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b507a7000) 00010000:00010000:1.0:1787829926.328947:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7f79 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.328969:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7f79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.328977:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7f79 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.329058:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829926.329120:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52388000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+42:2363:x1874675275712512:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 268us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829926.329129:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 51 00010000:00010000:1.0:1787829926.329158:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7f79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.329165:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7f79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787829926.329460:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1787829926.329712:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1787829926.329832:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7489fc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1874675284116864:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787829926.329893:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829926.329945:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284116864 00000100:00100000:1.0:1787829926.329950:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284116864 00000100:00100000:1.0:1787829926.330720:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787829926.330730:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7489e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5808:x1874675284116864:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787829926.330817:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7489e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5808:x1874675284116864:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 88us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829926.330825:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787829926.330851:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b81e32cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787829926.330874:0:5808:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1787829926.330880:0:5808:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1787829926.330902:0:5808:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e9b7fb612c0, transno 4294967301 00000100:00100000:1.0:1787829926.330924:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7489fc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1874675284116864:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1787829926.332162:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1787829926.332403:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1787829926.332528:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7489fc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1874675284116992:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787829926.332607:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829926.332643:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b81e329c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787829926.333202:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284116992 00000100:00100000:3.0:1787829926.333214:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284116992 00000100:00100000:3.0:1787829926.333281:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787829926.333292:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7489e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5808:x1874675284116992:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787829926.333549:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7489e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5808:x1874675284116992:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 258us (941us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787829926.333559:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787829926.333740:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7489fc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1874675284116992:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787829926.333827:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1787829926.333884:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7f79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.333897:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7f79 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.333921:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7f79 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.333928:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164e400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829926.333933:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7f79 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.333943:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7f79 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.333978:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b507a7000) 00010000:00010000:0.0:1787829926.333982:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787829926.333988:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7f79 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.333995:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d7f79 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787829926.334280:0:5808:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787829926.334399:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1787829926.334415:0:5808:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 306235397181ns, next at 307235393954ns, rc = 0 00000001:00080000:0.0:1787829926.334422:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1787829926.334460:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b507a7000) 00010000:00010000:0.0:1787829926.334463:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787829926.334471:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d7f64 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88c7 expref: 46 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829926.334594:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b50360450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+45:10543:x1874675275712384:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 13767us (13977us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1787829926.334616:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 26 00000020:00080000:0.0:1787829926.334622:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787829926.338779:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829926.338889:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275712640 00000100:00100000:2.0:1787829926.338901:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275712640 00000100:00100000:2.0:1787829926.338992:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 100 00000100:00100000:2.0:1787829926.339006:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52388f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+45:10543:x1874675275712640:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:3.0:1787829926.339476:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829926.339514:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7f80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c88ce expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829926.339608:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7f80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88ce expref: 46 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829926.339626:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7f80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88ce expref: 46 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829926.339650:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:3.0:1787829926.339685:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787829926.339690:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164e200, rc 0) 00000100:00100000:3.0:1787829926.339780:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52388f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+46:10543:x1874675275712640:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 777us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829926.339790:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 100 00000100:00100000:3.0:1787829926.344549:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829926.344673:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275712896 00000100:00100000:2.0:1787829926.344689:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275712896 00000100:00100000:2.0:1787829926.344767:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 27 00000100:00100000:2.0:1787829926.344778:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5238a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+46:10543:x1874675275712896:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:2.0:1787829926.345374:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5238a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+47:10543:x1874675275712896:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 594us (838us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1787829926.345384:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 27 00000100:00100000:1.0:1787829926.423450:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829926.423586:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275713024 00000100:00100000:2.0:1787829926.423600:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275713024 00000100:00100000:2.0:1787829926.423701:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 101 00000100:00100000:2.0:1787829926.423713:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7489da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+47:10553:x1874675275713024:12345-192.168.201.51@tcp:34:lfs.0 00010000:00010000:2.0:1787829926.423822:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7f87 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.423844:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7f87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.423881:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7f87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.423901:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d7f8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.423909:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d7f8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.423916:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d7f8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.424103:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7f95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.424113:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.424120:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787829926.424173:0:7257:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.424188:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7f87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.424195:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7f87 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.424203:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7f87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.424222:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3ec00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829926.424227:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7f87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.424236:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7f87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.424590:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:2.0:1787829926.424594:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829926.424599:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7f87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.424615:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d7f87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.424633:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d7f8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.424639:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d7f8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.424645:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d7f8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.424650:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3ee00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829926.424663:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d7f8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.424669:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d7f8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.424688:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e9b45193d00) 00010000:00010000:2.0:1787829926.424691:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829926.424694:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d7f8e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.424701:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d7f8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.424718:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.424724:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7f95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.424730:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7f95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.424735:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3e600 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829926.424738:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7f95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.424744:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7f95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.424752:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:2.0:1787829926.424755:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829926.424758:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7f95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.424764:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d7f95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829926.424966:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7489da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+47:10553:x1874675275713024:12345-192.168.201.51@tcp:34:lfs.0 Request processed in 1244us (1519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829926.424977:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 101 00000100:00100000:3.0:1787829926.474150:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829926.474384:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275713280 00000100:00100000:1.0:1787829926.474396:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275713280 00000100:00100000:1.0:1787829926.474473:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 102 00000100:00100000:1.0:1787829926.474498:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5238bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+47:10556:x1874675275713280:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:1.0:1787829926.474527:0:10044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829926.474555:0:10044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d7f9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c88d5 expref: -99 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.474670:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d7fa3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.474691:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d7fa3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.474705:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d7fa3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.474724:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d7faa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.474733:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d7faa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.474740:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d7faa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.474926:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d7fb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.474972:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d7fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.474980:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d7fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787829926.474994:0:10044:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787829926.475172:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d7fa3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.475181:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d7fa3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.475188:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d7fa3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.475195:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feee400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829926.475200:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d7fa3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.475209:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d7fa3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.475224:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:1.0:1787829926.475227:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829926.475234:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d7fa3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.475666:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d7fa3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.475687:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d7faa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.475704:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d7faa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.475710:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d7faa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.475715:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feeee00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829926.475719:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d7faa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.475725:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d7faa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.475734:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e9b507a7d00) 00010000:00010000:1.0:1787829926.475737:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829926.475741:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d7faa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.475751:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d7faa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.475813:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d7f9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88d5 expref: 50 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.475830:0:10044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d7fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88d5 expref: 49 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.475838:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:1.0:1787829926.475840:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787829926.475848:0:10044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feef200, rc 0) 00000100:00100000:1.0:1787829926.475948:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5238bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+49:10556:x1874675275713280:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 1465us (1812us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1787829926.475958:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 102 00000100:00100000:1.0:1787829926.482463:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829926.482762:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275713408 00000100:00100000:3.0:1787829926.482777:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275713408 00000100:00100000:3.0:1787829926.482859:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 103 00000100:00100000:3.0:1787829926.482872:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7489f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+49:10556:x1874675275713408:12345-192.168.201.51@tcp:54:lfs.0 00010000:00010000:3.0:1787829926.482976:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7fbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829926.482997:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7fbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829926.483011:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7fbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829926.483081:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7fbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829926.483089:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7fbf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829926.483096:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7fbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829926.483103:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164ec00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829926.483108:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7fbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829926.483135:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7fbf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829926.483149:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:3.0:1787829926.483152:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787829926.483158:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7fbf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829926.483165:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7fbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829926.483412:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7489f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+49:10556:x1874675275713408:12345-192.168.201.51@tcp:54:lfs.0 Request processed in 542us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829926.483423:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 103 00000100:00100000:3.0:1787829926.488001:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829926.488152:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275713664 00000100:00100000:0.0:1787829926.488165:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275713664 00000100:00100000:0.0:1787829926.488255:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 28 00000100:00100000:0.0:1787829926.488267:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+49:10556:x1874675275713664:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:0.0:1787829926.488567:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+50:10556:x1874675275713664:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 302us (581us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1787829926.488576:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 28 00010000:00010000:2.0:1787829926.563930:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829926.576311:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829926.576388:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275713920 00000100:00100000:0.0:1787829926.576402:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275713920 00000100:00100000:0.0:1787829926.576484:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 104 00000100:00100000:0.0:1787829926.576497:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7489cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+50:10566:x1874675275713920:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:0.0:1787829926.576534:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829926.576539:0:7257:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787829926.576576:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d7f41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88b9 expref: 50 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.576602:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:0.0:1787829926.576620:0:7257:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787829926.576638:0:7257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ee00/0xc03b4d103c0d7fc6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c88dc expref: -99 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.576814:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7fcd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.576833:0:7257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d7fb1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88d5 expref: 50 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.576843:0:7257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7fcd lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.576895:0:7257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d7fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88d5 expref: 50 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.576912:0:7257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d7fb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88d5 expref: 50 pid: 10044 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829926.576927:0:7257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b42c8ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7257:1874675284117120:192.168.201.51@tcp:104: 00000100:00100000:0.0:1787829926.577234:0:7257:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51060c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787829926.580351:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829926.580826:0:7257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b42c8ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7257:1874675284117120:192.168.201.51@tcp:104: 00010000:00010000:0.0:1787829926.580864:0:7257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7fcd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829926.580923:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275714048 00000100:00100000:2.0:1787829926.580932:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275714048 00010000:00010000:2.0:1787829926.584478:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d7fb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88d5 expref: 51 pid: 10044 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829926.584588:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 52 00000100:00100000:2.0:1787829926.584609:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+51:2362:x1874675275714048:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787829926.584637:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829926.584645:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d7fb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88d5 expref: 51 pid: 10044 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.584670:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d7fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88d5 expref: 51 pid: 10044 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.584701:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d7fb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88d5 expref: 51 pid: 10044 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.584723:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:2.0:1787829926.584730:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7fcd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.584741:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7fcd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.584750:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7fcd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829926.584812:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787829926.584891:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+50:2362:x1874675275714048:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 294us (4554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829926.584899:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 52 00010000:00010000:1.0:1787829926.585001:0:7257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7fcd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.585012:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7fcd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787829926.585053:0:7257:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787829926.585350:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ee00/0xc03b4d103c0d7fc6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88dc expref: 51 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.585369:0:7257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7fcd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88dc expref: 50 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.585377:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:1.0:1787829926.585381:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787829926.585383:0:7257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7fa7fa00, rc 0) 00000100:00100000:1.0:1787829926.585416:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7489cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+50:10566:x1874675275713920:12345-192.168.201.51@tcp:101:bash.0 Request processed in 8924us (9124us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1787829926.585425:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 104 00000100:00100000:1.0:1787829926.588049:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829926.588149:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275714304 00000100:00100000:3.0:1787829926.588161:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275714304 00000100:00100000:3.0:1787829926.588243:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 105 00000100:00100000:3.0:1787829926.588253:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7489ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+50:10566:x1874675275714304:12345-192.168.201.51@tcp:36:bash.0 00010000:00010000:3.0:1787829926.588595:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7fdb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829926.588619:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7fdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829926.588633:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7fdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787829926.588735:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1787829926.588762:0:5805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a22dc50f reply state 000000009cae56ff transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7fdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829926.588773:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787829926.588910:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7489ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+53:10566:x1874675275714304:12345-192.168.201.51@tcp:36:bash.0 Request processed in 656us (903us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1787829926.588919:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 105 00000020:00080000:3.0:1787829926.588927:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787829926.593002:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829926.593159:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275714432 00000100:00100000:0.0:1787829926.593173:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275714432 00000100:00100000:0.0:1787829926.593262:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 106 00000100:00100000:0.0:1787829926.593272:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+53:10566:x1874675275714432:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:0.0:1787829926.593306:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829926.593354:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d7fe2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c88e3 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.593482:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7fe9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.593501:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7fcd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88dc expref: 54 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.593509:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7fdb lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.593517:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7fe9 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.593540:0:5806:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7fdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.593571:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7fcd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88dc expref: 54 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.593589:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7fcd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88dc expref: 54 pid: 7257 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829926.593606:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b42c8ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1874675284117248:192.168.201.51@tcp:104: 00000100:00100000:0.0:1787829926.593727:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51060c00 going to sleep for 11 seconds 00010000:00010000:1.0:1787829926.594912:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7fdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.594950:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7fdb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.594958:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7fdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.594965:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164ec00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829926.594969:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7fdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.594977:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7fdb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.594997:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:1.0:1787829926.595001:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829926.595005:0:3264:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7fe9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.595034:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7fdb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.595042:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d7fdb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829926.597466:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b42c8ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1874675284117248:192.168.201.51@tcp:104: 00010000:00010000:0.0:1787829926.597512:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7fe9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829926.597617:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829926.597706:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275714560 00000100:00100000:1.0:1787829926.597715:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275714560 00010000:00010000:1.0:1787829926.597763:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7fcd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88dc expref: 54 pid: 7257 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829926.597808:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 53 00000100:00100000:1.0:1787829926.597819:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+54:2362:x1874675275714560:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787829926.597850:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829926.597857:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7fcd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88dc expref: 54 pid: 7257 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.597871:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7fcd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88dc expref: 54 pid: 7257 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.597900:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d7fcd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88dc expref: 54 pid: 7257 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.597917:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:1.0:1787829926.597921:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7fe9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.597932:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.597940:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7fe9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.597973:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829926.598078:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+53:2362:x1874675275714560:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 260us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829926.598087:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 53 00010000:00010000:0.0:1787829926.598561:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.598570:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787829926.598633:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787829926.598639:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787829926.598674:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.598715:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d7fe2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88e3 expref: 53 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.598735:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88e3 expref: 52 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.598744:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:0.0:1787829926.598747:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787829926.598750:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7fa7f600, rc 0) 00000100:00100000:0.0:1787829926.598806:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+52:10566:x1874675275714432:12345-192.168.201.51@tcp:101:bash.0 Request processed in 5535us (5818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829926.598814:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 106 00000100:00100000:3.0:1787829926.602700:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829926.603004:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275714816 00000100:00100000:0.0:1787829926.603043:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275714816 00000100:00100000:0.0:1787829926.603118:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 29 00000100:00100000:0.0:1787829926.603132:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+52:10566:x1874675275714816:12345-192.168.201.51@tcp:35:bash.0 00000100:00100000:0.0:1787829926.603481:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+53:10566:x1874675275714816:12345-192.168.201.51@tcp:35:bash.0 Request processed in 351us (797us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1787829926.603501:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 29 00000100:00100000:1.0:1787829926.659693:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829926.659814:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275714944 00000100:00100000:0.0:1787829926.659831:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275714944 00000100:00100000:0.0:1787829926.659918:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 107 00000100:00100000:0.0:1787829926.659931:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7489cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+53:10572:x1874675275714944:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:0.0:1787829926.659975:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829926.660004:0:7257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d7ff0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c88ea expref: -99 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.660221:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fe00/0xc03b4d103c0d7ff7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.660248:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fe00/0xc03b4d103c0d7ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.660261:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fe00/0xc03b4d103c0d7ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787829926.660341:0:7257:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787829926.660346:0:7257:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787829926.660373:0:7257:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fe00/0xc03b4d103c0d7ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.660405:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d7ff0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88ea expref: 55 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.660427:0:7257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fe00/0xc03b4d103c0d7ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88ea expref: 54 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.660462:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:0.0:1787829926.660465:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787829926.660470:0:7257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7fa7fe00, rc 0) 00000100:00100000:0.0:1787829926.660727:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7489cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+54:10572:x1874675275714944:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 798us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829926.660737:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 107 00000100:00100000:3.0:1787829926.664288:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829926.664523:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275715072 00000100:00100000:1.0:1787829926.664537:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275715072 00000100:00100000:1.0:1787829926.664612:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 108 00000100:00100000:1.0:1787829926.664624:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+54:10572:x1874675275715072:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:1.0:1787829926.664681:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829926.664710:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d7ffe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c88f1 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.664800:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8005 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.664821:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8005 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.664836:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8005 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.664856:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef600/0xc03b4d103c0d800c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.664863:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef600/0xc03b4d103c0d800c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.664869:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef600/0xc03b4d103c0d800c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.665059:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d8013 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.665069:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d8013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.665076:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d8013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787829926.665128:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787829926.665140:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787829926.665167:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d8013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.665185:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d8013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.665371:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8005 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.665377:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8005 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.665385:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8005 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.665392:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feef000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829926.665398:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8005 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.665406:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8005 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.665422:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:1.0:1787829926.665425:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829926.665430:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8005 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.665437:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8005 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.665464:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef600/0xc03b4d103c0d800c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.665484:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef600/0xc03b4d103c0d800c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.665489:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef600/0xc03b4d103c0d800c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.665494:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feef600 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829926.665497:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef600/0xc03b4d103c0d800c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.665504:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef600/0xc03b4d103c0d800c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.665513:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e9b507a7d00) 00010000:00010000:1.0:1787829926.665516:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829926.665519:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef600/0xc03b4d103c0d800c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.665524:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef600/0xc03b4d103c0d800c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.665562:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d7ffe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88f1 expref: 56 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.665576:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d8013 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88f1 expref: 55 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.665584:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:1.0:1787829926.665586:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787829926.665595:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feee600, rc 0) 00000100:00100000:1.0:1787829926.665686:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+55:10572:x1874675275715072:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 1064us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829926.665696:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 108 00000100:00100000:1.0:1787829926.671815:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829926.671915:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275715328 00000100:00100000:0.0:1787829926.671929:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275715328 00000100:00100000:0.0:1787829926.672058:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 109 00000100:00100000:0.0:1787829926.672072:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+55:10572:x1874675275715328:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:0.0:1787829926.672106:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829926.672136:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d801a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c88f8 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.672522:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e600/0xc03b4d103c0d8021 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.672542:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88e3 expref: 56 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.672552:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d8013 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88f1 expref: 56 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.672561:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e600/0xc03b4d103c0d8021 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.672609:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d8013 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88f1 expref: 56 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.672655:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d8013 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88f1 expref: 56 pid: 5804 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829926.672675:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b42c8ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1874675284117376:192.168.201.51@tcp:104: 00010000:00010000:0.0:1787829926.672867:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88e3 expref: 56 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.672878:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7fe9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88e3 expref: 56 pid: 5806 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829926.672888:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b42c892c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1874675284117504:192.168.201.51@tcp:104: 00000100:00100000:0.0:1787829926.672921:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51060c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787829926.675696:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829926.675768:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275715456 00000100:00100000:1.0:1787829926.675783:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275715456 00010000:00010000:1.0:1787829926.675832:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d8013 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88f1 expref: 57 pid: 5804 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829926.675880:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 54 00000100:00100000:1.0:1787829926.675890:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+57:2363:x1874675275715456:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787829926.675910:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829926.675918:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d8013 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88f1 expref: 57 pid: 5804 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.675934:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d8013 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88f1 expref: 57 pid: 5804 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.675977:0:8409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:1.0:1787829926.675983:0:8409:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e600/0xc03b4d103c0d8021 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.675995:0:8409:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e600/0xc03b4d103c0d8021 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.676002:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829926.676109:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+57:2363:x1874675275715456:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 220us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829926.676141:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 54 00000100:00100000:3.0:1787829926.679791:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829926.679876:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275715584 00000100:00100000:1.0:1787829926.679887:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275715584 00010000:00010000:1.0:1787829926.679939:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7fe9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88e3 expref: 57 pid: 5806 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829926.679982:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 55 00000100:00100000:1.0:1787829926.679992:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b51a06450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+57:2362:x1874675275715584:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787829926.680011:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829926.680046:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7fe9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88e3 expref: 57 pid: 5806 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.680061:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7fe9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88e3 expref: 57 pid: 5806 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.680090:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:1.0:1787829926.680097:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e600/0xc03b4d103c0d8021 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.680108:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e600/0xc03b4d103c0d8021 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.680116:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e600/0xc03b4d103c0d8021 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.680139:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829926.680197:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b51a06450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+57:2362:x1874675275715584:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 206us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829926.680227:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 55 00010000:00010000:0.0:1787829926.681097:0:5806:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.51@tcp) returned -22 from blocking AST (req@000000005c3021be x1874675284117376) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d8013 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88f1 expref: 56 pid: 5804 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.681118:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d8013 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88f1 expref: 56 pid: 5804 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829926.681137:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b42c8ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1874675284117376:192.168.201.51@tcp:104: 00010000:00010000:0.0:1787829926.681151:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d7fe9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88e3 expref: 55 pid: 5806 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829926.681161:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b42c892c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1874675284117504:192.168.201.51@tcp:104: 00010000:00010000:0.0:1787829926.681196:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:0.0:1787829926.681216:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e600/0xc03b4d103c0d8021 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.681226:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e600/0xc03b4d103c0d8021 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.681233:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e600/0xc03b4d103c0d8021 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787829926.681265:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787829926.681459:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d801a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88f8 expref: 56 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.681476:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e600/0xc03b4d103c0d8021 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88f8 expref: 55 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.681484:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:0.0:1787829926.681487:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787829926.681490:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7fa7e600, rc 0) 00000100:00100000:0.0:1787829926.681551:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+55:10572:x1874675275715328:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 9483us (9752us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1787829926.681559:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 109 00000100:00100000:3.0:1787829926.693486:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829926.693628:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275715840 00000100:00100000:1.0:1787829926.693641:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275715840 00000100:00100000:1.0:1787829926.693731:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 7 00000100:00100000:1.0:1787829926.693742:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+55:10572:x1874675275715840:12345-192.168.201.51@tcp:103:lfs.0 00010000:00010000:1.0:1787829926.693765:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829926.693799:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d7f80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88ce expref: 55 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.693825:0:8409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:1.0:1787829926.693831:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829926.693907:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+54:10572:x1874675275715840:12345-192.168.201.51@tcp:103:lfs.0 Request processed in 167us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829926.693914:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 7 00000100:00100000:1.0:1787829926.696457:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829926.696569:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275715968 00000100:00100000:0.0:1787829926.696583:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275715968 00000100:00100000:0.0:1787829926.696668:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 110 00000100:00100000:0.0:1787829926.696680:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7489e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+54:10572:x1874675275715968:12345-192.168.201.51@tcp:58:lfs.0 00010000:00010000:0.0:1787829926.696829:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d802f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.696881:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d802f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829926.696894:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d802f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787829926.698761:0:7257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787829926.699480:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7489e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+54:10572:x1874675275715968:12345-192.168.201.51@tcp:58:lfs.0 Request processed in 2790us (3028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829926.699496:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 110 00000100:00100000:3.0:1787829926.702503:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829926.702617:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275716096 00000100:00100000:1.0:1787829926.702635:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275716096 00000100:00100000:1.0:1787829926.702785:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 111 00000100:00100000:1.0:1787829926.702797:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+54:10572:x1874675275716096:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:1.0:1787829926.702828:0:10044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829926.702860:0:10044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef600/0xc03b4d103c0d8036 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c88ff expref: -99 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.702945:0:10044:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d802f lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.703509:0:10044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef600/0xc03b4d103c0d8036 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88ff expref: 55 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.703559:0:10044:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d802f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.703580:0:10044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef600/0xc03b4d103c0d8036 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88ff expref: 55 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.703599:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:1.0:1787829926.703603:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787829926.703608:0:10044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef600/0xc03b4d103c0d8036 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88ff expref: 55 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829926.703616:0:10044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feef600, rc 0) 00000100:00100000:1.0:1787829926.703760:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+55:10572:x1874675275716096:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 964us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829926.703771:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 111 00010000:00010000:1.0:1787829927.587327:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787829927.714375:0:11648:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787829927.714387:0:11648:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787829927.714427:0:11648:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1787829927.714434:0:11648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787829927.715322:0:11648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b42c892c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11648:1874675284117632:192.168.201.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787829927.715756:0:11648:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b510603c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787829927.724614:0:11648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b42c892c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11648:1874675284117632:192.168.201.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787829927.727576:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829927.727712:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275716224 00000100:00100000:2.0:1787829927.727724:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275716224 00000100:00100000:2.0:1787829927.727812:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 112 00000100:00100000:2.0:1787829927.727823:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b42c892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+55:10574:x1874675275716224:12345-192.168.201.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787829927.727865:0:5806:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787829927.728057:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b42c892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+55:10574:x1874675275716224:12345-192.168.201.51@tcp:53:lhsmtool_posix.0 Request processed in 234us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829927.728066:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 112 00000100:00080000:3.0:1787829927.728200:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787829927.734118:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829927.734395:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275716352 00000100:00100000:2.0:1787829927.734409:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275716352 00000100:00100000:2.0:1787829927.734487:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 113 00000100:00100000:2.0:1787829927.734499:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+55:10574:x1874675275716352:12345-192.168.201.51@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787829927.734610:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d803d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.734656:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d803d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.734672:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d803d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.737227:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d8044 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.737252:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d8044 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.737265:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d8044 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.737302:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d804b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.737311:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d804b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.737318:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d804b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787829927.737370:0:7257:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787829927.737375:0:7257:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787829927.737389:0:7257:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d804b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.737402:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d803d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.737407:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d803d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.737414:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d803d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.737440:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3ec00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829927.737446:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d803d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.737455:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d803d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.737470:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e9b45193300) 00010000:00010000:2.0:1787829927.737473:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829927.737478:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d803d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.737484:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d803d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.737500:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d8044 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.737505:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d8044 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.737510:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d8044 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.737514:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3ee00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829927.737517:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d8044 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.737522:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d8044 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.737538:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9e9b45193d00) 00010000:00010000:2.0:1787829927.737541:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829927.737543:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d8044 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.737549:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d8044 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.737565:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d804b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.737571:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d804b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.737577:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d804b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.737582:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3e600 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829927.737584:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d804b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.737589:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d804b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.737595:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:2.0:1787829927.737597:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829927.737599:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d804b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.737604:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d804b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829927.737727:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+55:10574:x1874675275716352:12345-192.168.201.51@tcp:34:lhsmtool_posix.0 Request processed in 3226us (3619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829927.737739:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 113 00000100:00100000:0.0:1787829927.745653:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829927.745814:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275716608 00000100:00100000:1.0:1787829927.745825:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275716608 00000100:00100000:1.0:1787829927.745900:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 114 00000100:00100000:1.0:1787829927.745910:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b42c8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+55:10574:x1874675275716608:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787829927.745933:0:10044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829927.745956:0:10044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8052 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8906 expref: -99 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.746108:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8059 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.746144:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8059 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.746156:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8059 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787829927.746169:0:10044:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787829927.746284:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8059 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.746292:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8059 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.746299:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8059 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.746304:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feee000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829927.746309:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8059 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.746316:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8059 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.746329:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:1.0:1787829927.746332:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787829927.746336:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8059 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.746342:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8059 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.746384:0:10044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8052 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8906 expref: 57 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.746402:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e9b45193300) 00010000:00010000:1.0:1787829927.746404:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787829927.746408:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8052 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8906 expref: 57 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.746418:0:10044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feef000, rc 0) 00000100:00100000:1.0:1787829927.746492:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b42c8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+56:10574:x1874675275716608:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 583us (849us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1787829927.746500:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 114 00000100:00100000:0.0:1787829927.749521:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829927.749591:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275716736 00000100:00100000:2.0:1787829927.749601:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275716736 00000100:00100000:2.0:1787829927.749673:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 115 00000100:00100000:2.0:1787829927.749683:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b42c8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+56:10574:x1874675275716736:12345-192.168.201.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787829927.749736:0:5806:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787829927.749852:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b42c8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+56:10574:x1874675275716736:12345-192.168.201.51@tcp:53:lhsmtool_posix.0 Request processed in 170us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829927.749860:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 115 00000100:00100000:2.0:1787829927.753418:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829927.753659:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275716992 00000100:00100000:1.0:1787829927.753670:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275716992 00000100:00100000:1.0:1787829927.753728:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 116 00000100:00100000:1.0:1787829927.753738:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+56:10574:x1874675275716992:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787829927.753842:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829927.753849:0:7257:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787829927.753882:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fe00/0xc03b4d103c0d7ff7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88ea expref: 56 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.753902:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:1.0:1787829927.753908:0:7257:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787829927.753921:0:7257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8067 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c890d expref: -99 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787829927.757477:0:7257:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1787829927.757715:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d806e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.757748:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d806e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.757759:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d806e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.758588:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8067 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c890d expref: 58 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.758608:0:7257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d806e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c890d expref: 57 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.758617:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e9b507a7d00) 00010000:00010000:1.0:1787829927.758620:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787829927.758623:0:7257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feee000, rc 0) 00000100:00100000:1.0:1787829927.758718:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+57:10574:x1874675275716992:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 4980us (5312us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1787829927.758727:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 116 00000100:00100000:0.0:1787829927.768148:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829927.768253:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275717248 00000100:00100000:3.0:1787829927.768264:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275717248 00000100:00100000:3.0:1787829927.768324:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 117 00000100:00100000:3.0:1787829927.768334:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b42c883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+57:10574:x1874675275717248:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787829927.768393:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829927.768421:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d806e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c890d expref: 57 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.768458:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e9b507a7d00) 00010000:00010000:3.0:1787829927.768469:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787829927.768492:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d807c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.768506:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d807c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.768515:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d807c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.768532:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8083 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x513ddb87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.768539:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8083 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x513ddb87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.768546:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8083 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x513ddb87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.768626:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d807c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.768644:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d807c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.768652:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d807c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.768658:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164e600 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829927.768662:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d807c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.768678:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d807c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.768686:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:3.0:1787829927.768689:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829927.768694:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d807c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.768700:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d807c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.768710:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8083 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x513ddb87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.768715:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8083 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x513ddb87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.768722:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8083 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x513ddb87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.768726:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164e200 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829927.768729:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8083 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x513ddb87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.768735:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8083 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x513ddb87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.768741:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x513ddb87 (ffff9e9b478cc300) 00010000:00010000:3.0:1787829927.768743:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829927.768746:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8083 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x513ddb87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.768762:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8083 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x513ddb87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829927.768851:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b42c883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+56:10574:x1874675275717248:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 Request processed in 518us (712us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787829927.768859:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 117 00000100:00100000:0.0:1787829927.772446:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829927.772522:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275717376 00000100:00100000:3.0:1787829927.772532:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275717376 00000100:00100000:3.0:1787829927.772589:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 118 00000100:00100000:3.0:1787829927.772599:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b42c88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+56:10574:x1874675275717376:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787829927.772621:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829927.772653:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d808a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8914 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.772693:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d8091 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.772706:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d8091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.772717:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d8091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.772818:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d808a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8914 expref: 58 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.772837:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d8091 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8914 expref: 57 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.772858:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:3.0:1787829927.772861:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787829927.772864:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164fc00, rc 0) 00000100:00100000:3.0:1787829927.772918:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b42c88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+57:10574:x1874675275717376:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 321us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829927.772925:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 118 00000100:00100000:0.0:1787829927.776223:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829927.776334:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275717632 00000100:00100000:1.0:1787829927.776346:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275717632 00000100:00100000:1.0:1787829927.776407:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 119 00000100:00100000:1.0:1787829927.776416:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f547c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+57:10574:x1874675275717632:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787829927.776505:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8098 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.776523:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8098 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.776554:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8098 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787829927.776852:0:7257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1787829927.776863:0:7257:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 307677845180ns, next at 308677842288ns, rc = 0 00000004:00010000:1.0:1787829927.776966:0:7257:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d7641eb reply state 00000000a3442ce7 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8098 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829927.776976:0:7257:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787829927.777246:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f547c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+59:10574:x1874675275717632:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 Request processed in 829us (1033us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1787829927.777254:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 119 00000100:00100000:2.0:1787829927.778586:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fb612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284117888:0@lo:400:kworker.0 00000100:00100000:1.0:1787829927.778591:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fe6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284117760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787829927.780421:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829927.780487:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f383c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284118272:0@lo:400:kworker.0 00000100:00100000:2.0:1787829927.780522:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829927.780545:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787829927.780551:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f383480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1874675284118144:0@lo:400:kworker.0 00000100:00100000:2.0:1787829927.780577:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829927.780616:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284117888 00000100:00100000:2.0:1787829927.780623:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284117888 00000100:00100000:2.0:1787829927.780686:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1787829927.780694:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3279:x1874675284117888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829927.780743:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3279:x1874675284117888:12345-0@lo:400:kworker.0 Request processed in 49us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829927.780764:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1787829927.780812:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fb612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284117888:0@lo:400:kworker.0 00000100:00100000:2.0:1787829927.780836:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284118272 00000100:00100000:2.0:1787829927.780840:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284118272 00000100:00100000:2.0:1787829927.780881:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787829927.780888:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3279:x1874675284118272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829927.780925:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3279:x1874675284118272:12345-0@lo:400:kworker.0 Request processed in 38us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829927.780932:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1787829927.780949:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787829927.780969:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f383c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284118272:0@lo:400:kworker.0 00000100:00100000:2.0:1787829927.780986:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284118144 00000100:00100000:2.0:1787829927.781553:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284118144 00000100:00100000:2.0:1787829927.781601:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787829927.781608:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1874675284118144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829927.781669:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1874675284118144:12345-0@lo:400:kworker.0 Request processed in 61us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829927.781675:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:2.0:1787829927.781693:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787829927.781715:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f383480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1874675284118144:0@lo:400:kworker.0 00000100:00100000:3.0:1787829927.782174:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fb63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874675284118016:0@lo:400:kworker.0 00000100:00100000:3.0:1787829927.782316:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829927.782348:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787829927.782356:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b52387c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1874675284118400:0@lo:400:kworker.0 00000100:00100000:3.0:1787829927.782380:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829927.782407:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284118016 00000100:00100000:3.0:1787829927.782411:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284118016 00000100:00100000:3.0:1787829927.782439:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284118400 00000100:00100000:3.0:1787829927.782442:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284118400 00000100:00080000:3.0:1787829927.782458:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787829927.782482:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787829927.782488:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874675284118016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829927.782526:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874675284118016:12345-0@lo:400:kworker.0 Request processed in 37us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829927.782532:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787829927.782546:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787829927.782552:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874675284118400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829927.782579:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874675284118400:12345-0@lo:400:kworker.0 Request processed in 28us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829927.782601:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787829927.782642:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b52387c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1874675284118400:0@lo:400:kworker.0 00000100:00100000:3.0:1787829927.782654:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fb63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874675284118016:0@lo:400:kworker.0 00010000:00010000:2.0:1787829927.782922:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8098 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.782933:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8098 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.782950:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8098 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.782955:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feef000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829927.782960:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8098 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.782967:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8098 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.782995:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:2.0:1787829927.782998:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787829927.783003:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8098 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.783009:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8098 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829927.783124:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829927.783146:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275717760 00000100:00100000:2.0:1787829927.783151:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275717760 00000100:00100000:2.0:1787829927.783189:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 120 00000100:00100000:2.0:1787829927.783196:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+58:10574:x1874675275717760:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787829927.783214:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829927.783850:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d809f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c891b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.783915:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d809f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c891b expref: 59 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.783948:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d809f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c891b expref: 59 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.783968:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:2.0:1787829927.783971:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787829927.783974:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3ee00, rc 0) 00000100:00100000:2.0:1787829927.784065:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+59:10574:x1874675275717760:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 869us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829927.784073:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 120 00000100:00100000:1.0:1787829927.786853:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829927.786943:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787829927.786954:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b52387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284118528:0@lo:400:kworker.0 00000100:00100000:1.0:1787829927.786993:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829927.787150:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284117760 00000100:00100000:3.0:1787829927.787159:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284117760 00000100:00100000:0.0:1787829927.787205:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284118528 00000100:00100000:0.0:1787829927.787209:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284118528 00000100:00100000:3.0:1787829927.787233:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787829927.787235:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787829927.787242:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52389680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1874675284117760:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787829927.787242:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3280:x1874675284118528:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1787829927.787275:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787829927.787289:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3280:x1874675284118528:12345-0@lo:400:kworker.0 Request processed in 49us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829927.787296:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787829927.787304:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52389680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1874675284117760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829927.787309:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787829927.787447:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829927.787499:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b52387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284118528:0@lo:400:kworker.0 00000100:00100000:1.0:1787829927.787522:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fe6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284117760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787829927.787538:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275717888 00000100:00100000:2.0:1787829927.787543:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275717888 00000100:00080000:1.0:1787829927.787566:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787829927.787578:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 37 00000100:00100000:2.0:1787829927.787585:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+8:2363:x1874675275717888:12345-192.168.201.51@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787829927.787884:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+9:2363:x1874675275717888:12345-192.168.201.51@tcp:2:lhsmtool_posix.0 Request processed in 299us (438us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787829927.787891:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 37 00000100:00100000:3.0:1787829927.796366:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829927.796475:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275718144 00000100:00100000:0.0:1787829927.796501:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275718144 00000100:00100000:0.0:1787829927.796557:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 30 00000100:00100000:0.0:1787829927.796566:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+59:10574:x1874675275718144:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787829927.796799:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+60:10574:x1874675275718144:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 Request processed in 233us (442us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1787829927.796807:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 30 00000100:00100000:0.0:1787829927.799457:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829927.803524:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275718400 00000100:00100000:3.0:1787829927.803539:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275718400 00000100:00100000:3.0:1787829927.803679:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 121 00000100:00100000:3.0:1787829927.803691:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b523843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+60:10574:x1874675275718400:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787829927.803828:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b523843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+60:10574:x1874675275718400:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 Request processed in 139us (4380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829927.803836:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 121 00000100:00100000:1.0:1787829927.810735:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829927.810814:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275718528 00000100:00100000:3.0:1787829927.810833:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275718528 00000100:00100000:3.0:1787829927.810981:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 122 00000100:00100000:3.0:1787829927.810996:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+60:10574:x1874675275718528:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787829927.811067:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829927.811110:0:7257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d80a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8922 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.811204:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d80ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.811373:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d80ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.811386:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d80ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829927.811431:0:7257:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787829927.811449:0:7257:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d80ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.811479:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d80a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8922 expref: 62 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.811503:0:7257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d80ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8922 expref: 61 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.811514:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:3.0:1787829927.811517:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787829927.811522:0:7257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164e200, rc 0) 00000100:00100000:3.0:1787829927.811598:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+61:10574:x1874675275718528:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 607us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829927.811604:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 122 00000100:00100000:1.0:1787829927.815801:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829927.815917:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275718656 00000100:00100000:0.0:1787829927.815932:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275718656 00000100:00100000:0.0:1787829927.816061:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 38 00000100:00100000:0.0:1787829927.816073:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+9:2362:x1874675275718656:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787829927.816093:0:6651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829927.816450:0:6651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035f87f2e/0xc03b4d103c0d80b4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8929 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787829927.816494:0:6651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a901ea8, blocks: 0x1 00010000:00010000:2.0:1787829927.816522:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=307s v=(0 0) 00010000:00010000:2.0:1787829927.816527:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787829927.816540:0:6651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035f87f2e/0xc03b4d103c0d80b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8929 expref: 10 pid: 6651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.816583:0:6651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000035f87f2e/0xc03b4d103c0d80b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8929 expref: 10 pid: 6651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.816602:0:6651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3ec00, rc 0) 00000100:00100000:2.0:1787829927.816706:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+10:2362:x1874675275718656:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 633us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829927.816717:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 38 00000100:00100000:0.0:1787829927.820849:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829927.820978:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275718912 00000100:00100000:2.0:1787829927.820993:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275718912 00000100:00100000:2.0:1787829927.821331:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 123 00000100:00100000:2.0:1787829927.821342:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52385680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+61:10574:x1874675275718912:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787829927.821606:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52385680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+61:10574:x1874675275718912:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 Request processed in 265us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829927.821624:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 123 00000100:00100000:1.0:1787829927.825495:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829927.825769:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275719040 00000100:00100000:3.0:1787829927.825784:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275719040 00000100:00100000:3.0:1787829927.825884:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 39 00000100:00100000:3.0:1787829927.825896:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7a4b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+10:10574:x1874675275719040:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787829927.825930:0:6652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829927.825956:0:6652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fce78769/0xc03b4d103c0d80bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8930 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.825998:0:6652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000035f87f2e/0xc03b4d103c0d80b4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8929 expref: 11 pid: 6651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.826009:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787829927.826436:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787829927.826447:0:6652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fce78769/0xc03b4d103c0d80bb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8930 expref: 11 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.826494:0:6652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000035f87f2e/0xc03b4d103c0d80b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8929 expref: 11 pid: 6651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.826510:0:6652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000035f87f2e/0xc03b4d103c0d80b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8929 expref: 11 pid: 6651 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829927.826527:0:6652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fe6f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6652:1874675284118656:192.168.201.51@tcp:104: 00000100:00100000:3.0:1787829927.826664:0:6652:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b44d20cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787829927.830721:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829927.830889:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275719168 00000100:00100000:2.0:1787829927.830912:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275719168 00010000:00010000:2.0:1787829927.830970:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000035f87f2e/0xc03b4d103c0d80b4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8929 expref: 12 pid: 6651 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829927.831080:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 56 00000100:00100000:2.0:1787829927.831092:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe78f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+12:2362:x1874675275719168:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787829927.831115:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829927.831144:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000035f87f2e/0xc03b4d103c0d80b4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8929 expref: 12 pid: 6651 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.831513:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000035f87f2e/0xc03b4d103c0d80b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8929 expref: 12 pid: 6651 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.831548:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787829927.831553:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787829927.831563:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fce78769/0xc03b4d103c0d80bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8930 expref: 12 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.831574:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fce78769/0xc03b4d103c0d80bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8930 expref: 12 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.831642:0:5792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fce78769/0xc03b4d103c0d80bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8930 expref: 12 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829927.831660:0:5792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5792:1874675284118784:192.168.201.51@tcp:105: 00000100:00100000:2.0:1787829927.831772:0:5792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b7293c6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787829927.834803:0:6652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035f87f2e/0xc03b4d103c0d80b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8929 expref: 12 pid: 6651 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829927.834836:0:6652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fe6f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6652:1874675284118656:192.168.201.51@tcp:104: 00010000:00010000:3.0:1787829927.834920:0:6652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fce78769/0xc03b4d103c0d80bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c8930 expref: 11 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.834939:0:6652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164ec00, rc 0) 00000100:00100000:2.0:1787829927.835583:0:5792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5792:1874675284118784:192.168.201.51@tcp:105: 00010000:00010000:2.0:1787829927.835603:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787829927.835712:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7a4b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+11:10574:x1874675275719040:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 9817us (10229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829927.835726:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 39 00000100:00100000:2.0:1787829927.842569:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe78f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+10:2362:x1874675275719168:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 11111us (11495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829927.842591:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 56 00000100:00100000:0.0:1787829927.849788:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829927.850003:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275719296 00000100:00100000:1.0:1787829927.850386:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275719296 00002000:00100000:1.0:1787829927.850458:0:6655:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9e9b52385a40 x1874675275719296/t0(0) o4->b6abf229-545c-43fd-8dee-d9adf582be48@192.168.201.51@tcp:508/0 lens 504/0 e 0 to 0 dl 1787829938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787829927.850470:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e9b52385a40 with x1874675275719296 ext(0->12) 00002000:00010000:1.0:1787829927.850476:0:6655:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e9b52385a40 00000100:00100000:1.0:1787829927.850815:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 2 00000100:00100000:1.0:1787829927.850827:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52385a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b6abf229-545c-43fd-8dee-d9adf582be48+10:2362:x1874675275719296:12345-192.168.201.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787829927.851818:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52385a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b6abf229-545c-43fd-8dee-d9adf582be48+12:2362:x1874675275719296:12345-192.168.201.51@tcp:4:lhsmtool_posix.0 Request processed in 984us (2037us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787829927.851830:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 2 00002000:00100000:1.0:1787829927.851840:0:6655:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9e9b52385a40 x1874675275719296/t4294967308(0) o4->b6abf229-545c-43fd-8dee-d9adf582be48@192.168.201.51@tcp:508/0 lens 504/448 e 0 to 0 dl 1787829938 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787829927.851850:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e9b52385a40 with x1874675275719296 ext(0->12) 00002000:00010000:1.0:1787829927.851855:0:6655:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e9b52385a40 00000100:00100000:3.0:1787829927.854764:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829927.854942:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275719424 00000100:00100000:0.0:1787829927.854955:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275719424 00000100:00100000:0.0:1787829927.855045:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 124 00000100:00100000:0.0:1787829927.855057:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+61:10574:x1874675275719424:12345-192.168.201.51@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787829927.922837:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+61:10574:x1874675275719424:12345-192.168.201.51@tcp:44:lhsmtool_posix.0 Request processed in 67763us (68068us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829927.922858:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 124 00000001:00080000:3.0:1787829927.923063:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1787829927.923085:0:5827:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:3.0:1787829927.923106:0:5827:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1787829927.923137:0:5827:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e9b81e32cc0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1787829927.923142:0:5827:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e9b4f8ced00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e9b81e32c00 00000020:00080000:3.0:1787829927.923145:0:5827:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e9b4f8cec00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e9b74efc800 00000004:00080000:3.0:1787829927.923195:0:5827:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1787829927.923404:0:5827:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e9b47e28a80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1787829927.923409:0:5827:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e9b585aa700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e9b47e28b40 00000020:00080000:3.0:1787829927.923411:0:5827:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e9b585aa100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e9b74e86800 00000020:00080000:3.0:1787829927.923601:0:5838:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1787829927.923831:0:5838:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787829927.923856:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fe6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284118912:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787829927.924048:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829927.924134:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787829927.924141:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fe6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284119040:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787829927.924341:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829927.924406:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284118912 00000100:00100000:3.0:1787829927.924416:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284118912 00000100:00100000:3.0:1787829927.924466:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284119040 00000100:00100000:3.0:1787829927.924470:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284119040 00000100:00100000:3.0:1787829927.924493:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787829927.924503:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3278:x1874675284118912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787829927.924539:0:8603:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:3.0:1787829927.924573:0:8603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019d2ef4e/0xc03b4d103c0d80c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.924600:0:8603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000062d2d37a/0xc03b4d103c0d7e84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.51@tcp remote: 0x53172783628c888f expref: 11 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.924610:0:8603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787829927.924616:0:8603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787829927.924621:0:8603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019d2ef4e/0xc03b4d103c0d80c2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.924668:0:8603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000062d2d37a/0xc03b4d103c0d7e84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.51@tcp remote: 0x53172783628c888f expref: 11 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.924685:0:8603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000062d2d37a/0xc03b4d103c0d7e84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.51@tcp remote: 0x53172783628c888f expref: 11 pid: 6652 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829927.924700:0:8603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fe6f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8603:1874675284119168:192.168.201.51@tcp:104: 00000100:00100000:3.0:1787829927.924764:0:8603:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b44d20900 going to sleep for 11 seconds 00000100:00100000:3.0:1787829927.924783:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787829927.924802:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3278:x1874675284119040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787829927.926164:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fe79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284119296:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787829927.926372:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829927.930135:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829927.930381:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829927.930426:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275719680 00000100:00100000:1.0:1787829927.930437:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275719680 00010000:00010000:1.0:1787829927.930486:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000062d2d37a/0xc03b4d103c0d7e84 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.51@tcp remote: 0x53172783628c888f expref: 12 pid: 6652 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829927.930528:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 57 00000100:00100000:1.0:1787829927.930557:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe7b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+12:2363:x1874675275719680:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787829927.930581:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829927.930588:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000062d2d37a/0xc03b4d103c0d7e84 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.51@tcp remote: 0x53172783628c888f expref: 12 pid: 6652 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.930604:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000062d2d37a/0xc03b4d103c0d7e84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.51@tcp remote: 0x53172783628c888f expref: 12 pid: 6652 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.930649:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787829927.930654:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787829927.930661:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000019d2ef4e/0xc03b4d103c0d80c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.930673:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019d2ef4e/0xc03b4d103c0d80c2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.930701:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829927.930771:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe7b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+12:2363:x1874675275719680:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 216us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829927.930781:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 57 00010000:00010000:2.0:1787829927.930954:0:8603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062d2d37a/0xc03b4d103c0d7e84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.51@tcp remote: 0x53172783628c888f expref: 11 pid: 6652 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829927.930973:0:8603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fe6f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8603:1874675284119168:192.168.201.51@tcp:104: 00010000:00010000:2.0:1787829927.931000:0:8603:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000019d2ef4e/0xc03b4d103c0d80c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.931013:0:8603:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000019d2ef4e/0xc03b4d103c0d80c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.931064:0:8603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019d2ef4e/0xc03b4d103c0d80c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.931076:0:8603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019d2ef4e/0xc03b4d103c0d80c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.931084:0:8603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019d2ef4e/0xc03b4d103c0d80c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829927.931109:0:8603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787829927.932423:0:6651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787829927.932431:0:6651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787829928 00002000:00010000:3.0:1787829927.932434:0:6651:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787829927.932437:0:6651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787829928 -> 1787829928 00002000:00010000:3.0:1787829927.932439:0:6651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787829927.932541:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3278:x1874675284119040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 7735us (8369us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787829927.932553:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787829927.932584:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284119296 00000100:00100000:3.0:1787829927.932592:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284119296 00000100:00100000:3.0:1787829927.932621:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275719552 00000100:00100000:3.0:1787829927.932624:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275719552 00000100:00100000:3.0:1787829927.932651:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787829927.932659:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3280:x1874675284119296:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787829927.932696:0:6651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1787829927.932736:0:6651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a901ea6, atime: 0x6a901ea6, ctime: 0x6a901ea6, blocks: 0x1 00010000:00010000:3.0:1787829927.932745:0:6651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce2cc006/0xc03b4d103c0d80c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.932762:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=307s v=(0 0) 00010000:00010000:3.0:1787829927.932767:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787829927.932774:0:6651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce2cc006/0xc03b4d103c0d80c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.932790:0:6651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce2cc006/0xc03b4d103c0d80c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.932816:0:6651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce2cc006/0xc03b4d103c0d80c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.932824:0:6651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce2cc006/0xc03b4d103c0d80c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.932849:0:6651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1787829927.933524:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3278:x1874675284118912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9016us (9503us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787829927.933534:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787829927.933562:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 43 00000100:00100000:2.0:1787829927.933572:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+11:2363:x1874675275719552:12345-192.168.201.51@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1787829927.934124:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e9b7fe6e1c0/2, rc 0, transno 4294967309 00000100:00100000:1.0:1787829927.934135:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fe6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284119040:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1787829927.934149:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e9b7fe6fc00/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787829927.934152:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fe6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284118912:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787829927.934445:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787829927.934456:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019d2ef4e/0xc03b4d103c0d80c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829927.934469:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164e600 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787829927.934475:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019d2ef4e/0xc03b4d103c0d80c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829927.934505:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019d2ef4e/0xc03b4d103c0d80c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829927.934529:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019d2ef4e/0xc03b4d103c0d80c2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829927.934538:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019d2ef4e/0xc03b4d103c0d80c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829927.934562:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787829927.934566:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce2cc006/0xc03b4d103c0d80c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829927.934574:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164e400 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787829927.934577:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce2cc006/0xc03b4d103c0d80c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829927.934585:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce2cc006/0xc03b4d103c0d80c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829927.934595:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce2cc006/0xc03b4d103c0d80c9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829927.934603:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce2cc006/0xc03b4d103c0d80c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829927.934639:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829927.934642:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829927.934644:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787829927.936365:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3280:x1874675284119296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3697us (9983us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787829927.936382:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:3.0:1787829927.936427:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787829927.936696:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e9b7fe79680/2, rc 0, transno 4294967304 00000100:00100000:0.0:1787829927.936705:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fe79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284119296:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1787829927.983328:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1787829927.983357:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1787829927.983378:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:3.0:1787829927.983749:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+6:2363:x1874675275719552:12345-192.168.201.51@tcp:16:lhsmtool_posix.0 Request processed in 50169us (53619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829927.983764:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 43 00000100:00100000:1.0:1787829927.987116:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829927.987409:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275719936 00000100:00100000:3.0:1787829927.987423:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275719936 00000100:00100000:3.0:1787829927.987547:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 125 00000100:00100000:3.0:1787829927.987560:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+15:10574:x1874675275719936:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787829927.987648:0:7257:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829927.987684:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d80ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8922 expref: 15 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.987710:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:3.0:1787829927.987717:0:7257:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787829927.987759:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d80d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.987786:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d80d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829927.987799:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d80d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787829927.988706:0:7257:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009363792f reply state 000000004e04006e transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d80d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829927.988725:0:7257:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787829927.988944:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+16:10574:x1874675275719936:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 Request processed in 1383us (1840us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1787829927.989102:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 125 00010000:00010000:1.0:1787829927.993132:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d80d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.993156:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d80d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.993175:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d80d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.993191:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164e400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829927.993197:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d80d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.993205:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d80d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.993233:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:1.0:1787829927.993236:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829927.993242:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d80d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829927.993249:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d80d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829927.995732:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829927.996156:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275720064 00000100:00100000:0.0:1787829927.996185:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275720064 00000100:00100000:0.0:1787829927.996319:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 44 00000100:00100000:0.0:1787829927.996332:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:2362:x1874675275720064:12345-192.168.201.51@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787829927.996685:0:6652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787829927.996690:0:6652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787829928 -> 1787829927 00002000:00010000:0.0:1787829927.996693:0:6652:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787829926 00002000:00010000:0.0:1787829927.996696:0:6652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787829928 -> 1787829927 00002000:00010000:0.0:1787829927.996699:0:6652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787829927.997009:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+7:2362:x1874675275720064:12345-192.168.201.51@tcp:2:lhsmtool_posix.0 Request processed in 678us (1291us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787829927.997059:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 44 00000100:00100000:2.0:1787829928.001596:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829928.002428:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275720320 00000100:00100000:3.0:1787829928.002445:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275720320 00000100:00100000:3.0:1787829928.002527:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 126 00000100:00100000:3.0:1787829928.002540:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+15:10574:x1874675275720320:12345-192.168.201.51@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787829928.002648:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d80d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.002671:0:10044:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d8091 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8914 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.002682:0:10044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d80d7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.002725:0:10044:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d8091 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8914 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.002758:0:10044:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d8091 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8914 expref: 15 pid: 5805 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829928.002777:0:10044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fe6cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10044:1874675284119424:192.168.201.51@tcp:104: 00000100:00100000:3.0:1787829928.003555:0:10044:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b44d20a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787829928.006520:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829928.006640:0:10044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fe6cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10044:1874675284119424:192.168.201.51@tcp:104: 00010000:00010000:2.0:1787829928.006678:0:10044:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d80d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829928.007348:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275720448 00000100:00100000:1.0:1787829928.007360:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275720448 00010000:00010000:1.0:1787829928.007413:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d8091 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8914 expref: 16 pid: 5805 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829928.007512:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 58 00000100:00100000:1.0:1787829928.007525:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6abf229-545c-43fd-8dee-d9adf582be48+16:2363:x1874675275720448:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787829928.007561:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829928.007570:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d8091 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8914 expref: 16 pid: 5805 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.007585:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d8091 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8914 expref: 16 pid: 5805 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.007614:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d8091 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8914 expref: 16 pid: 5805 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.007642:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:1.0:1787829928.007648:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d80d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.007659:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d80d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.007668:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d80d7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.007704:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829928.007780:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6abf229-545c-43fd-8dee-d9adf582be48+15:2363:x1874675275720448:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 257us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829928.007789:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 58 00010000:00010000:3.0:1787829928.007857:0:10044:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d80d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.007865:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d80d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.007917:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d80d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.007924:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d80d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.007931:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d80d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.007937:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164e200 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829928.007942:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d80d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.007951:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d80d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.007972:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:3.0:1787829928.007983:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787829928.007988:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d80d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.007995:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d80d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829928.008073:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+14:10574:x1874675275720320:12345-192.168.201.51@tcp:55:lhsmtool_posix.0 Request processed in 5535us (6493us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787829928.008082:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 126 00000100:00100000:3.0:1787829928.011153:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829928.011421:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275720576 00000100:00100000:2.0:1787829928.011435:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275720576 00000100:00100000:2.0:1787829928.011504:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 45 00000100:00100000:2.0:1787829928.011517:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+7:2362:x1874675275720576:12345-192.168.201.51@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787829928.011579:0:6651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c617c198/0xc03b4d103c0d80de lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829928.011604:0:6651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fce78769/0xc03b4d103c0d80bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c8930 expref: 7 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829928.011613:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787829928.011618:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787829928.011633:0:6651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c617c198/0xc03b4d103c0d80de lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829928.011682:0:6651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fce78769/0xc03b4d103c0d80bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8930 expref: 7 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829928.011699:0:6651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fce78769/0xc03b4d103c0d80bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8930 expref: 7 pid: 6652 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829928.011717:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f3840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6651:1874675284119552:192.168.201.51@tcp:104: 00000100:00100000:2.0:1787829928.011829:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b523e5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787829928.015113:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f3840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6651:1874675284119552:192.168.201.51@tcp:104: 00010000:00010000:2.0:1787829928.015157:0:6651:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c617c198/0xc03b4d103c0d80de lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829928.017184:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829928.017592:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275720704 00000100:00100000:1.0:1787829928.017606:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275720704 00010000:00010000:1.0:1787829928.017672:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fce78769/0xc03b4d103c0d80bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8930 expref: 8 pid: 6652 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829928.017753:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 59 00000100:00100000:1.0:1787829928.017764:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+8:2362:x1874675275720704:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787829928.017785:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829928.017816:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fce78769/0xc03b4d103c0d80bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8930 expref: 8 pid: 6652 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.017831:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fce78769/0xc03b4d103c0d80bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8930 expref: 8 pid: 6652 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.017862:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fce78769/0xc03b4d103c0d80bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8930 expref: 8 pid: 6652 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.017883:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787829928.017887:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787829928.017893:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c617c198/0xc03b4d103c0d80de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.017905:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c617c198/0xc03b4d103c0d80de lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.017941:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829928.018037:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+7:2362:x1874675275720704:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 252us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829928.018046:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 59 00010000:00010000:3.0:1787829928.018197:0:6651:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c617c198/0xc03b4d103c0d80de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.018208:0:6651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c617c198/0xc03b4d103c0d80de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.018390:0:6651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c617c198/0xc03b4d103c0d80de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.018399:0:6651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c617c198/0xc03b4d103c0d80de lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.018408:0:6651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c617c198/0xc03b4d103c0d80de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.018416:0:6651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f800 already unused, calling callback (ffffffffc1651420) 00010000:00010000:3.0:1787829928.018428:0:6651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c617c198/0xc03b4d103c0d80de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.018439:0:6651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c617c198/0xc03b4d103c0d80de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.018453:0:6651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c617c198/0xc03b4d103c0d80de lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.018461:0:6651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c617c198/0xc03b4d103c0d80de lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829928.018521:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+6:2362:x1874675275720576:12345-192.168.201.51@tcp:1:lhsmtool_posix.0 Request processed in 7005us (7380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829928.018531:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 45 00000100:00100000:0.0:1787829928.023074:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829928.023350:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275720960 00000100:00100000:1.0:1787829928.023363:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275720960 00000100:00100000:1.0:1787829928.023428:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 127 00000100:00100000:1.0:1787829928.023440:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52384780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+14:10574:x1874675275720960:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787829928.023547:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d80e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.023570:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d80e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.023584:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d80e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.023877:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d80ec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.023891:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d809f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c891b expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.023901:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d80ec lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.023945:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d809f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c891b expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.023975:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d809f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c891b expref: 15 pid: 5806 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829928.023993:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fe7a580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1874675284119680:192.168.201.51@tcp:104: 00000100:00100000:1.0:1787829928.024132:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47f4b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787829928.028606:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829928.028813:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fe7a580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1874675284119680:192.168.201.51@tcp:104: 00010000:00010000:1.0:1787829928.028852:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d80ec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829928.029014:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275721088 00000100:00100000:2.0:1787829928.029069:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275721088 00010000:00010000:2.0:1787829928.029120:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d809f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c891b expref: 16 pid: 5806 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829928.029163:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 60 00000100:00100000:2.0:1787829928.029174:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52387480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+16:2362:x1874675275721088:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787829928.029206:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829928.029222:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d809f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c891b expref: 16 pid: 5806 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829928.029237:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d809f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c891b expref: 16 pid: 5806 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829928.029267:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d809f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c891b expref: 16 pid: 5806 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829928.029282:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:2.0:1787829928.029286:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d80ec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829928.029294:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d80ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829928.029319:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d80ec lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829928.029340:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787829928.029401:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52387480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+15:2362:x1874675275721088:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 230us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829928.029407:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 60 00010000:00010000:0.0:1787829928.029686:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d80ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829928.029696:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d80ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787829928.030136:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1787829928.030654:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1787829928.030713:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1787829928.030850:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b52387c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5805:1874675284119808:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787829928.032550:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829928.032605:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51060e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787829928.032692:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284119808 00000100:00100000:3.0:1787829928.032705:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284119808 00000100:00100000:3.0:1787829928.032815:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787829928.032826:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b47a79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5805:x1874675284119808:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787829928.033000:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b47a79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5805:x1874675284119808:12345-0@lo:1000:mdt00_001.0 Request processed in 175us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829928.033008:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787829928.033125:0:5805:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787829928.033133:0:5805:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:0.0:1787829928.033159:0:5805:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e9b7fe6e1c0, transno 4294967309 00000004:00080000:0.0:1787829928.033195:0:5805:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e9b7fe6fc00, transno 4294967310 00000100:00100000:0.0:1787829928.033204:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b52387c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5805:1874675284119808:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787829928.033843:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1787829928.033950:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b52387c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5805:1874675284119936:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787829928.034014:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829928.035517:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47e280c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787829928.035565:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284119936 00000100:00100000:1.0:1787829928.035575:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284119936 00000100:00100000:1.0:1787829928.035649:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787829928.035660:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5805:x1874675284119936:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787829928.036602:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5805:x1874675284119936:12345-0@lo:1000:mdt00_001.0 Request processed in 937us (2582us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787829928.036613:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787829928.036713:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b52387c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5805:1874675284119936:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787829928.036772:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d80ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829928.036786:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d80ec lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829928.036794:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d80ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829928.036801:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feee800 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829928.036806:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d80ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829928.036834:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d80ec lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829928.036854:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:0.0:1787829928.036857:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787829928.036864:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d80ec lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829928.036870:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d80ec lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829928.037381:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d802f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829928.037391:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d802f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829928.037398:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d802f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829928.037403:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7e400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829928.037406:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d802f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829928.037413:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d802f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829928.037422:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:0.0:1787829928.037425:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787829928.037434:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef600/0xc03b4d103c0d8036 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88ff expref: 18 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829928.037461:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef600/0xc03b4d103c0d8036 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88ff expref: 18 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829928.037472:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef600/0xc03b4d103c0d8036 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88ff expref: 18 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829928.037518:0:5805:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef600/0xc03b4d103c0d8036 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88ff expref: 18 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829928.037536:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c4780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1874675284120064:192.168.201.51@tcp:105: 00000100:00100000:0.0:1787829928.037660:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51060c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787829928.041168:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829928.041402:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275721216 00000100:00100000:2.0:1787829928.041412:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275721216 00000100:00100000:2.0:1787829928.041481:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 31 00000100:00100000:2.0:1787829928.041493:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+19:10572:x1874675275721216:12345-192.168.201.51@tcp:49:lfs.0 00000100:00100000:2.0:1787829928.041676:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+19:10572:x1874675275721216:12345-192.168.201.51@tcp:49:lfs.0 Request processed in 185us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829928.041685:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 31 00000100:00100000:1.0:1787829928.047339:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c4780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1874675284120064:192.168.201.51@tcp:105: 00010000:00010000:1.0:1787829928.047378:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d802f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.047389:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d802f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.047433:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d80f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.047448:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d80f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.047459:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d80f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.047470:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d80f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.047477:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d80f3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.047505:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d80f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.047512:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feef000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829928.047517:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d80f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.047526:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d80f3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.047540:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:1.0:1787829928.047543:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829928.047547:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d80f3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.047553:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d80f3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.047564:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d80e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.047570:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d80e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.047577:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d80e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.047582:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feef400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829928.047585:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d80e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.047601:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d80e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.047608:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:1.0:1787829928.047609:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787829928.047612:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d80e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.047615:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d80e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829928.048004:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52384780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+18:10574:x1874675275720960:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 Request processed in 24563us (24991us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1787829928.048042:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 127 00000020:00080000:1.0:1787829928.048053:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787829928.049861:0:11648:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787829928.049871:0:11648:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787829928.050423:0:11648:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787829928.050432:0:11648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787829928.053755:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829928.053877:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829928.054072:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275721728 00000100:00100000:0.0:1787829928.054085:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275721728 00000100:00100000:0.0:1787829928.054153:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 32 00000100:00100000:0.0:1787829928.054172:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b50362450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+18:10574:x1874675275721728:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787829928.055224:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275721472 00000100:00100000:3.0:1787829928.055233:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275721472 00000100:00100000:3.0:1787829928.055295:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 128 00000100:00100000:3.0:1787829928.055303:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+20:10572:x1874675275721472:12345-192.168.201.51@tcp:58:lfs.0 00000004:00080000:0.0:1787829928.055877:0:5808:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787829928.056565:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1787829928.056656:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d80fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829928.056678:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d80fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829928.056710:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d80fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829928.056720:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d80fa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829928.056727:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d80fa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829928.056734:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d80fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787829928.056987:0:7257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1787829928.057119:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+21:10572:x1874675275721472:12345-192.168.201.51@tcp:58:lfs.0 Request processed in 1812us (3377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829928.057128:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 128 00010000:00010000:0.0:1787829928.057316:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787829928.057368:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b50362450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+20:10574:x1874675275721728:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 Request processed in 3206us (3492us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1787829928.057375:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 32 00000020:00080000:0.0:1787829928.057377:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787829928.058307:0:11133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787829928.058319:0:11133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d80fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.058327:0:11133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7f400 already unused, calling callback (ffffffffc1651420) 00010000:00010000:1.0:1787829928.058331:0:11133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d80fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.058339:0:11133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d80fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.058355:0:11133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e9b48f25200) 00010000:00010000:1.0:1787829928.058358:0:11133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787829928.058362:0:11133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d80fa lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.058386:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d80fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829928.058468:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829928.058471:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829928.058472:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787829928.086943:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829928.090404:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275721856 00000100:00100000:2.0:1787829928.090430:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275721856 00000100:00100000:3.0:1787829928.090651:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 129 00000100:00100000:3.0:1787829928.090666:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+20:10576:x1874675275721856:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:3.0:1787829928.090703:0:10044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829928.090732:0:10044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d8101 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8937 expref: -99 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.090827:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8108 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.090850:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8108 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.090864:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8108 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.090883:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d810f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.090892:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d810f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.091138:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d810f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.091683:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d8116 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.091709:0:10044:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e600/0xc03b4d103c0d8021 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88f8 expref: 21 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.091719:0:10044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d8116 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.091766:0:10044:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e600/0xc03b4d103c0d8021 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88f8 expref: 21 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829928.091786:0:10044:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e600/0xc03b4d103c0d8021 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88f8 expref: 21 pid: 5806 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829928.091804:0:10044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fe6cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10044:1874675284120192:192.168.201.51@tcp:104: 00000100:00100000:3.0:1787829928.092434:0:10044:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b44d206c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787829928.096819:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829928.096913:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275722112 00000100:00100000:1.0:1787829928.096927:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275722112 00000100:00100000:1.0:1787829928.097006:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 33 00000100:00100000:1.0:1787829928.097038:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+22:5599:x1874675275722112:12345-192.168.201.51@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787829928.098225:0:10044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fe6cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10044:1874675284120192:192.168.201.51@tcp:104: 00010000:00010000:0.0:1787829928.098265:0:10044:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d8116 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829928.098565:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+23:5599:x1874675275722112:12345-192.168.201.51@tcp:35:ldlm_bl.0 Request processed in 1547us (1759us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1787829928.098577:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 33 00000100:00100000:3.0:1787829928.101938:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829928.102239:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275722240 00000100:00100000:1.0:1787829928.102254:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275722240 00010000:00010000:1.0:1787829928.102311:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e600/0xc03b4d103c0d8021 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88f8 expref: 23 pid: 5806 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829928.102364:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 61 00000100:00100000:1.0:1787829928.102376:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b51a04850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+23:2362:x1874675275722240:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787829928.102395:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829928.102404:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e600/0xc03b4d103c0d8021 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88f8 expref: 23 pid: 5806 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.102421:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e600/0xc03b4d103c0d8021 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88f8 expref: 23 pid: 5806 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.102454:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e600/0xc03b4d103c0d8021 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c88f8 expref: 23 pid: 5806 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.102497:0:8409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:1.0:1787829928.102504:0:8409:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d8116 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.102516:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d8116 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.102525:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d8116 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.102565:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829928.102641:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b51a04850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+22:2362:x1874675275722240:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 266us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829928.102650:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 61 00010000:00010000:1.0:1787829928.102722:0:10044:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d8116 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.102732:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d8116 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787829928.102793:0:10044:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787829928.102799:0:10044:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787829928.102822:0:10044:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d8116 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.102837:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d8116 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.102848:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8108 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.102867:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8108 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.102875:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8108 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.102882:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164e200 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829928.102887:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8108 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.102909:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8108 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.102919:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:1.0:1787829928.102922:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829928.102926:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8108 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.102933:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8108 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.102944:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d810f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.102951:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d810f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.102965:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d810f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.102971:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164ec00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829928.102983:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d810f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.102990:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d810f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.102999:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e9b478ccf00) 00010000:00010000:1.0:1787829928.103002:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829928.103005:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d810f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.103011:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d810f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.103104:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d8101 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8937 expref: 22 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.103119:0:10044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d8116 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8937 expref: 21 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829928.103126:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:1.0:1787829928.103129:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787829928.103131:0:10044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164fc00, rc 0) 00000100:00100000:1.0:1787829928.103185:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+21:10576:x1874675275721856:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 12523us (16259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829928.103193:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 129 00000100:00100000:0.0:1787829928.290566:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787829928.290600:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fe78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284120320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787829928.290708:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829928.290862:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284120320 00000100:00100000:1.0:1787829928.290872:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284120320 00000100:00100000:1.0:1787829928.290960:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787829928.290973:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1874675284120320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787829928.291063:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787829928.291124:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1874675284120320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829928.291132:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1787829928.291389:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787829928.291518:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fe78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284120320:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787829928.613290:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787829928.883271:0:12066:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787829928.883285:0:12066:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787829928.883356:0:12066:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787829928.883364:0:12066:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787829929.066585:0:11648:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787829929.066602:0:11648:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787829929.070383:0:11648:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787829929.070394:0:11648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787829929.070584:0:11648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fe6e940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11648:1874675284120448:192.168.201.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787829929.070734:0:11648:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b44d20a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787829929.076508:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829929.076887:0:11648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fe6e940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11648:1874675284120448:192.168.201.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787829929.083205:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275722368 00000100:00100000:3.0:1787829929.083533:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275722368 00000100:00100000:3.0:1787829929.083839:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 130 00000100:00100000:3.0:1787829929.083853:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+21:10588:x1874675275722368:12345-192.168.201.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787829929.083903:0:5805:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00080000:1.0:1787829929.085319:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787829929.085857:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+21:10588:x1874675275722368:12345-192.168.201.51@tcp:53:lhsmtool_posix.0 Request processed in 1998us (9355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829929.085872:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 130 00000100:00100000:1.0:1787829929.109269:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829929.110512:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275722624 00000100:00100000:3.0:1787829929.110530:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275722624 00000100:00100000:3.0:1787829929.110625:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 131 00000100:00100000:3.0:1787829929.110638:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+21:10588:x1874675275722624:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787829929.110668:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829929.110699:0:7257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d811d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c893e expref: -99 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829929.110838:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d8124 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829929.110858:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d8124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829929.110877:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d8124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829929.110892:0:7257:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787829929.112651:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d811d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c893e expref: 24 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829929.112683:0:7257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d8124 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c893e expref: 23 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829929.112726:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:3.0:1787829929.112730:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787829929.112734:0:7257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164e400, rc 0) 00000100:00100000:3.0:1787829929.112832:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+23:10588:x1874675275722624:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 2195us (3575us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1787829929.112843:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 131 00000100:00100000:1.0:1787829929.120506:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829929.121405:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275722880 00000100:00100000:0.0:1787829929.121425:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275722880 00000100:00100000:0.0:1787829929.121506:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 132 00000100:00100000:0.0:1787829929.121518:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+23:10588:x1874675275722880:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787829929.121637:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ee00/0xc03b4d103c0d8132 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829929.121660:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ee00/0xc03b4d103c0d8132 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829929.121675:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ee00/0xc03b4d103c0d8132 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829929.122480:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ee00/0xc03b4d103c0d8132 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829929.122493:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ee00/0xc03b4d103c0d8132 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829929.122501:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ee00/0xc03b4d103c0d8132 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829929.122507:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7ee00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829929.122512:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ee00/0xc03b4d103c0d8132 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829929.122521:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ee00/0xc03b4d103c0d8132 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829929.122538:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:0.0:1787829929.122547:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787829929.122554:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ee00/0xc03b4d103c0d8132 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829929.122562:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ee00/0xc03b4d103c0d8132 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829929.123305:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+24:10588:x1874675275722880:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 Request processed in 1783us (2805us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1787829929.123317:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 132 00000040:00080000:1.0:1787829929.123872:0:11648:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787829929.123879:0:11648:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787829929.124380:0:11648:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787829929.124390:0:11648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787829929.127597:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829929.129541:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829929.129947:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275723264 00000100:00100000:1.0:1787829929.129961:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275723264 00000100:00100000:1.0:1787829929.130062:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 34 00000100:00100000:1.0:1787829929.130073:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+24:10588:x1874675275723264:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787829929.130657:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+25:10588:x1874675275723264:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 Request processed in 581us (1125us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1787829929.130669:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 34 00000100:00100000:2.0:1787829929.131784:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275723008 00000100:00100000:2.0:1787829929.131796:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275723008 00000100:00100000:2.0:1787829929.131871:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 8 00000100:00100000:2.0:1787829929.131882:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+25:2360:x1874675275723008:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787829929.131900:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829929.131933:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d8124 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c893e expref: 25 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829929.131979:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:2.0:1787829929.131985:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787829929.132067:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+24:2360:x1874675275723008:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 186us (4484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829929.132075:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 8 00010000:00010000:3.0:1787829929.637194:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787829929.759103:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829929.759222:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829929.759267:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829929.759344:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829929.759412:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275723392 00000100:00100000:0.0:1787829929.759425:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275723392 00000100:00100000:0.0:1787829929.759506:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 290 00000100:00100000:0.0:1787829929.759518:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2360:x1874675275723392:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787829929.759633:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2360:x1874675275723392:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 117us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829929.759641:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 290 00000100:00100000:1.0:1787829929.759892:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275723776 00000100:00100000:1.0:1787829929.759898:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275723776 00000100:00100000:1.0:1787829929.759978:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 143 00000100:00100000:1.0:1787829929.759987:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:902200d4-578b-4474-a651-ffe6603128fa+5:2360:x1874675275723776:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829929.760053:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:902200d4-578b-4474-a651-ffe6603128fa+5:2360:x1874675275723776:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 68us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829929.760071:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 143 00000100:00080000:0.0:1787829929.760612:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787829929.767690:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275723520 00000100:00100000:2.0:1787829929.767713:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275723520 00000100:00100000:0.0:1787829929.768135:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275723648 00000100:00100000:0.0:1787829929.768141:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275723648 00000100:00080000:1.0:1787829929.774580:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787829929.774605:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787829929.774929:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 67 00000100:00100000:2.0:1787829929.774974:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+6:2360:x1874675275723520:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829929.775111:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+6:2360:x1874675275723520:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 170us (16026us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829929.775121:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 67 00000100:00100000:0.0:1787829929.777091:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 68 00000100:00100000:0.0:1787829929.777115:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+7:2360:x1874675275723648:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787829929.777487:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+7:2360:x1874675275723648:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 381us (18140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829929.777497:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 68 00010000:00010000:1.0:1787829930.658485:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787829930.759641:0:12117:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787829930.759651:0:12117:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787829930.759695:0:12117:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787829930.759701:0:12117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787829930.949427:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829930.949511:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275724032 00000100:00100000:3.0:1787829930.949521:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275724032 00000100:00100000:3.0:1787829930.949595:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 133 00000100:00100000:3.0:1787829930.949606:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+24:10608:x1874675275724032:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:3.0:1787829930.949630:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829930.949654:0:7257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d8139 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8945 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829930.949751:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d8140 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829930.949766:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d8140 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829930.949790:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d8140 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829930.949803:0:7257:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787829930.949922:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d8139 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8945 expref: 27 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829930.949941:0:7257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d8140 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8945 expref: 26 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829930.949951:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:3.0:1787829930.949954:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787829930.949958:0:7257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b4164ec00, rc 0) 00000100:00100000:3.0:1787829930.950421:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+26:10608:x1874675275724032:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 816us (1000us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787829930.950430:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 133 00000001:00080000:1.0:1787829930.951353:0:7602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:1.0:1787829930.951372:0:7602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000100:00100000:1.0:1787829930.955771:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829930.956204:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275724160 00000100:00100000:0.0:1787829930.956214:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275724160 00000100:00100000:0.0:1787829930.956285:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 134 00000100:00100000:0.0:1787829930.956310:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+26:10608:x1874675275724160:12345-192.168.201.51@tcp:54:lfs.0 00010000:00010000:0.0:1787829930.956393:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f800/0xc03b4d103c0d814e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829930.956410:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f800/0xc03b4d103c0d814e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829930.956422:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f800/0xc03b4d103c0d814e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829930.956447:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f800/0xc03b4d103c0d814e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829930.956455:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f800/0xc03b4d103c0d814e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829930.956462:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f800/0xc03b4d103c0d814e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829930.956467:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7f800 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829930.956471:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f800/0xc03b4d103c0d814e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829930.956480:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f800/0xc03b4d103c0d814e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829930.956493:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:0.0:1787829930.956496:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787829930.956502:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f800/0xc03b4d103c0d814e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829930.956508:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f800/0xc03b4d103c0d814e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829930.956604:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+26:10608:x1874675275724160:12345-192.168.201.51@tcp:54:lfs.0 Request processed in 297us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829930.956612:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 134 00000100:00100000:3.0:1787829931.049382:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829931.049526:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275724288 00000100:00100000:2.0:1787829931.049534:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275724288 00000100:00100000:2.0:1787829931.049617:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 46 00000100:00100000:2.0:1787829931.049629:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+6:2361:x1874675275724288:12345-192.168.201.51@tcp:101:cat.0 00010000:00010000:2.0:1787829931.049647:0:6650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829931.049668:0:6650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000324f7c36/0xc03b4d103c0d8155 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c894c expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787829931.049694:0:6650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a901ea7, atime: 0x6a901ea6, ctime: 0x6a901ea7, blocks: 0xb 00010000:00010000:2.0:1787829931.049712:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=310s v=(0 0) 00010000:00010000:2.0:1787829931.049717:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787829931.049726:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000324f7c36/0xc03b4d103c0d8155 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c894c expref: 7 pid: 6650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829931.049758:0:6650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000324f7c36/0xc03b4d103c0d8155 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c894c expref: 7 pid: 6650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829931.049772:0:6650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3f200, rc 0) 00000100:00100000:2.0:1787829931.049841:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+7:2361:x1874675275724288:12345-192.168.201.51@tcp:101:cat.0 Request processed in 215us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829931.049847:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 46 00000100:00080000:1.0:1787829931.050059:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787829931.053557:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829931.054279:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275724416 00000100:00100000:1.0:1787829931.054290:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275724416 00002000:00100000:1.0:1787829931.054341:0:6657:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9e9b7fec43c0 x1874675275724416/t0(0) o3->b6abf229-545c-43fd-8dee-d9adf582be48@192.168.201.51@tcp:512/0 lens 488/0 e 0 to 0 dl 1787829942 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787829931.054353:0:6657:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e9b7fec43c0 with x1874675275724416 ext(0->4095) 00002000:00010000:1.0:1787829931.054358:0:6657:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e9b7fec43c0 00000100:00100000:1.0:1787829931.054394:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 3 00000100:00100000:1.0:1787829931.054404:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b6abf229-545c-43fd-8dee-d9adf582be48+7:2360:x1874675275724416:12345-192.168.201.51@tcp:3:cat.0 00000100:00100000:1.0:1787829931.054777:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b6abf229-545c-43fd-8dee-d9adf582be48+7:2360:x1874675275724416:12345-192.168.201.51@tcp:3:cat.0 Request processed in 373us (1229us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787829931.054785:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 3 00002000:00100000:1.0:1787829931.054792:0:6657:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9e9b7fec43c0 x1874675275724416/t0(0) o3->b6abf229-545c-43fd-8dee-d9adf582be48@192.168.201.51@tcp:512/0 lens 488/4536 e 0 to 0 dl 1787829942 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787829931.054821:0:6657:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e9b7fec43c0 with x1874675275724416 ext(0->4095) 00002000:00010000:1.0:1787829931.054825:0:6657:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e9b7fec43c0 00010000:00010000:0.0:1787829931.682991:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829932.707485:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787829932.898305:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284120576:0@lo:400:kworker.0 00000100:00100000:3.0:1787829932.898403:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829932.898660:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fe78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284120832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787829932.898697:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829932.898746:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284120832 00000100:00100000:1.0:1787829932.898754:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284120832 00000100:00100000:1.0:1787829932.898815:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787829932.898825:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1874675284120832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787829932.898862:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787829932.898909:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1874675284120832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829932.898917:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1787829932.898938:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787829932.898973:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fe78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284120832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787829932.899737:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284120576 00000100:00100000:2.0:1787829932.899745:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284120576 00000100:00100000:2.0:1787829932.899785:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787829932.899793:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3278:x1874675284120576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829932.903200:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1874675284120960:0@lo:400:kworker.0 00000100:00100000:1.0:1787829932.903279:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829932.903342:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284120960 00000100:00100000:1.0:1787829932.903349:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284120960 00000100:00100000:1.0:1787829932.903405:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787829932.903415:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874675284120960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829932.903469:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874675284120960:12345-0@lo:400:kworker.0 Request processed in 56us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829932.903477:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:1.0:1787829932.903497:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787829932.903528:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1874675284120960:0@lo:400:kworker.0 00000100:00100000:0.0:1787829932.905138:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874675284120704:0@lo:400:kworker.0 00000100:00100000:0.0:1787829932.905195:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829932.905226:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fef4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284121216:0@lo:400:kworker.0 00000100:00100000:0.0:1787829932.905249:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829932.905269:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787829932.905274:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fef52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1874675284121088:0@lo:400:kworker.0 00000100:00100000:0.0:1787829932.905296:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829932.905334:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284121216 00000100:00100000:0.0:1787829932.905341:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284121216 00000100:00100000:0.0:1787829932.905565:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787829932.905576:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284121216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829932.905624:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284121216:12345-0@lo:400:kworker.0 Request processed in 52us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829932.905631:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787829932.905652:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284120704 00000100:00100000:0.0:1787829932.905655:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284120704 00000100:00100000:0.0:1787829932.905675:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284121088 00000100:00100000:0.0:1787829932.905678:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284121088 00000100:00100000:0.0:1787829932.905697:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787829932.905703:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f32ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1874675284120704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829932.905732:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f32ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1874675284120704:12345-0@lo:400:kworker.0 Request processed in 29us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829932.905754:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787829932.905765:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787829932.905771:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1874675284121088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829932.905794:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1874675284121088:12345-0@lo:400:kworker.0 Request processed in 24us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829932.905800:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787829932.905831:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fef52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1874675284121088:0@lo:400:kworker.0 00000100:00100000:0.0:1787829932.905841:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874675284120704:0@lo:400:kworker.0 00000100:00100000:0.0:1787829932.905849:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1787829932.905854:0:3279:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1787829932.905875:0:3279:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e9b7fe79680, transno 4294967304 00000100:00100000:0.0:1787829932.905885:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fef4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284121216:0@lo:400:kworker.0 00000100:00080000:0.0:1787829932.905916:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787829932.905920:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787829932.911286:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3278:x1874675284120576:12345-0@lo:400:kworker.0 Request processed in 11483us (12872us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829932.911302:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1787829932.931922:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284120576:0@lo:400:kworker.0 00000001:00080000:3.0:1787829932.954102:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:3.0:1787829932.954122:0:5827:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e9b51060e40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1787829932.954126:0:5827:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e9b51a4b900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e9b510603c0 00000020:00080000:3.0:1787829932.954130:0:5827:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e9b51a4b700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e9b81e37800 00000001:00080000:3.0:1787829932.954163:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000001:00080000:3.0:1787829932.954178:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1787829932.954188:0:5827:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1787829932.954724:0:5838:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1787829932.954893:0:5838:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000040:00080000:3.0:1787829933.218290:0:11648:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787829933.218300:0:11648:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787829933.218340:0:11648:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787829933.218347:0:11648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787829933.410652:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787829933.410680:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fe78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284121344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787829933.410754:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829933.410818:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284121344 00000100:00100000:1.0:1787829933.410825:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284121344 00000100:00100000:1.0:1787829933.410869:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787829933.410877:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284121344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787829933.410911:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787829933.410952:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284121344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829933.410960:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787829933.411002:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fe78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284121344:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1787829933.465493:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1787829933.465509:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:0.0:1787829933.731856:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829934.760256:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829934.878408:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829934.878458:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829934.878491:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275724672 00000100:00100000:0.0:1787829934.878497:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829934.878501:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275724672 00000100:00100000:0.0:1787829934.878543:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829934.878569:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829934.878579:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275725056 00000100:00100000:1.0:1787829934.878582:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275725056 00000100:00080000:0.0:1787829934.878587:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787829934.878599:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275724928 00000100:00100000:0.0:1787829934.878602:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275724928 00000100:00100000:1.0:1787829934.878605:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 147 00000100:00100000:1.0:1787829934.878614:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+13:2360:x1874675275724672:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787829934.878641:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275724800 00000100:00100000:0.0:1787829934.878644:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275724800 00000100:00100000:0.0:1787829934.878663:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 70 00000100:00100000:0.0:1787829934.878668:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+5:2360:x1874675275724928:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829934.878692:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+13:2360:x1874675275724672:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 78us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829934.878692:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+5:2360:x1874675275724928:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 24us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829934.878700:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 147 00000100:00100000:0.0:1787829934.878700:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 70 00000100:00100000:1.0:1787829934.878715:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 148 00000100:00100000:0.0:1787829934.878715:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 71 00000100:00100000:1.0:1787829934.878721:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:902200d4-578b-4474-a651-ffe6603128fa+5:2360:x1874675275725056:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787829934.878721:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+6:2360:x1874675275724800:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829934.878819:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275724544 00000100:00100000:3.0:1787829934.878833:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275724544 00000100:00100000:3.0:1787829934.878899:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 292 00000100:00100000:1.0:1787829934.878903:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:902200d4-578b-4474-a651-ffe6603128fa+5:2360:x1874675275725056:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 22us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829934.878912:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2360:x1874675275724544:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829934.878933:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 148 00000100:00080000:1.0:1787829934.878967:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787829934.878970:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787829934.879056:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+6:2360:x1874675275724800:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 294us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829934.879064:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 71 00000100:00100000:3.0:1787829934.879708:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2360:x1874675275724544:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 794us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829934.879720:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 292 00010000:00010000:2.0:1787829935.778306:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829936.501012:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829936.501366:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275725184 00000100:00100000:2.0:1787829936.501382:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275725184 00000100:00100000:2.0:1787829936.501507:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 135 00000100:00100000:2.0:1787829936.501524:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f545680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+13:10253:x1874675275725184:12345-192.168.201.51@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787829936.501674:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f545680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+13:10253:x1874675275725184:12345-192.168.201.51@tcp:60:lhsmtool_posix.0 Request processed in 156us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829936.501683:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 135 00000100:00080000:1.0:1787829936.501962:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787829936.511397:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829936.511704:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275725440 00000100:00100000:0.0:1787829936.511718:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275725440 00000100:00100000:0.0:1787829936.511794:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 35 00000100:00100000:0.0:1787829936.511805:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+13:10253:x1874675275725440:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787829936.512555:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+14:10253:x1874675275725440:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 Request processed in 745us (1168us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1787829936.512567:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 35 00000100:00100000:3.0:1787829936.676419:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829936.676725:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275725568 00000100:00100000:2.0:1787829936.676738:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275725568 00000100:00100000:2.0:1787829936.676897:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 136 00000100:00100000:2.0:1787829936.676910:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:902200d4-578b-4474-a651-ffe6603128fa+5:11060:x1874675275725568:12345-192.168.201.51@tcp:101:lsof.0 00010000:00010000:2.0:1787829936.676940:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829936.676979:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d815c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8953 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829936.677128:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8163 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829936.677147:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829936.677163:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787829936.677432:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787829936.677437:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787829936.677559:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829936.677589:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d815c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8953 expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829936.677611:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8163 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8953 expref: 6 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829936.677622:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b45193f00) 00010000:00010000:2.0:1787829936.677626:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787829936.677638:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3f400, rc 0) 00000100:00100000:2.0:1787829936.677724:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:902200d4-578b-4474-a651-ffe6603128fa+6:11060:x1874675275725568:12345-192.168.201.51@tcp:101:lsof.0 Request processed in 816us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829936.677732:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 136 00000100:00080000:1.0:1787829936.679948:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787829936.802645:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829937.834118:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829938.019350:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f383c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284121856:0@lo:400:kworker.0 00000100:00100000:0.0:1787829938.019471:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829938.019642:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284121856 00000100:00100000:2.0:1787829938.019653:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284121856 00000100:00100000:3.0:1787829938.019795:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3281:1874675284121472:0@lo:400:kworker.0 00000100:00100000:3.0:1787829938.019838:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829938.019868:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f382940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284121600:0@lo:400:kworker.0 00000100:00100000:3.0:1787829938.019897:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829938.020279:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284121472 00000100:00100000:3.0:1787829938.020284:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284121472 00000100:00100000:3.0:1787829938.020331:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1787829938.020342:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3281:x1874675284121472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829938.020412:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3281:x1874675284121472:12345-0@lo:400:kworker.0 Request processed in 70us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829938.020421:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:3.0:1787829938.020485:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787829938.028538:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787829938.028574:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284121856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829938.028709:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284121856:12345-0@lo:400:kworker.0 Request processed in 156us (9239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829938.030051:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f383480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1874675284121728:0@lo:400:kworker.0 00000100:00100000:0.0:1787829938.030142:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829938.030842:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787829938.032695:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284121600 00000100:00100000:0.0:1787829938.032713:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284121600 00000100:00100000:0.0:1787829938.032782:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284121728 00000100:00100000:0.0:1787829938.032785:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284121728 00000100:00100000:0.0:1787829938.032826:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787829938.032837:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284121600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829938.032958:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284121600:12345-0@lo:400:kworker.0 Request processed in 119us (13056us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829938.032967:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787829938.032987:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787829938.032993:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b44cc0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1874675284121728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829938.033051:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b44cc0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1874675284121728:12345-0@lo:400:kworker.0 Request processed in 59us (2910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829938.033058:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:0.0:1787829938.033080:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787829938.033125:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1787829938.033132:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1787829938.033161:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f383c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284121856:0@lo:400:kworker.0 00000100:00100000:3.0:1787829938.034874:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3281:1874675284121472:0@lo:400:kworker.0 00000100:00100000:3.0:1787829938.034894:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fb61680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1874675284121984:0@lo:400:kworker.0 00000100:00100000:3.0:1787829938.034969:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829938.035056:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284121984 00000100:00100000:3.0:1787829938.035063:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284121984 00000100:00100000:3.0:1787829938.035122:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787829938.035132:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874675284121984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829938.035183:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874675284121984:12345-0@lo:400:kworker.0 Request processed in 53us (214us total) trans 0 rc 0/0 00000100:00080000:0.0:1787829938.046998:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787829938.047118:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f383480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1874675284121728:0@lo:400:kworker.0 00000100:00100000:0.0:1787829938.047172:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fb62580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284122240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787829938.050314:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f382940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284121600:0@lo:400:kworker.0 00000100:00100000:1.0:1787829938.050338:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fb60b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284122112:0@lo:400:kworker.0 00000100:00100000:3.0:1787829938.052444:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787829938.052585:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fb61680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1874675284121984:0@lo:400:kworker.0 00000100:00100000:1.0:1787829938.058583:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829938.058898:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284122112 00000100:00100000:1.0:1787829938.058911:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284122112 00000100:00100000:1.0:1787829938.059007:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787829938.059040:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe79e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284122112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829938.059118:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe79e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284122112:12345-0@lo:400:kworker.0 Request processed in 103us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829938.059126:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787829938.059220:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fb60b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284122112:0@lo:400:kworker.0 00000100:00080000:1.0:1787829938.059256:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787829938.060506:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829938.061039:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284122240 00000100:00100000:2.0:1787829938.061049:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284122240 00000100:00100000:2.0:1787829938.061110:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787829938.061120:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b44cc3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284122240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787829938.061168:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787829938.061248:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b44cc3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284122240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829938.061256:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787829938.061427:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fb62580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284122240:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1787829938.120011:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1787829938.120054:0:5827:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1787829938.120222:0:5838:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1787829938.120237:0:5838:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1787829938.530632:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787829938.530665:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fe792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284122368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787829938.530953:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829938.534412:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284122368 00000100:00100000:2.0:1787829938.534433:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284122368 00000100:00100000:2.0:1787829938.534565:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787829938.534575:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7a5e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284122368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787829938.534629:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787829938.534766:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7a5e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284122368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 193us (3995us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829938.534900:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fe792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284122368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787829938.535100:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:2.0:1787829938.852897:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829939.882198:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829939.999433:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829939.999481:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829939.999515:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829939.999538:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829939.999571:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829939.999606:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275726080 00000100:00100000:1.0:1787829939.999633:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275726080 00000100:00100000:1.0:1787829939.999695:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275725952 00000100:00100000:1.0:1787829939.999697:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275725952 00000100:00100000:1.0:1787829939.999719:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 74 00000100:00100000:1.0:1787829939.999729:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+5:2361:x1874675275726080:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829939.999810:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+5:2361:x1874675275726080:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 83us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829939.999817:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 74 00000100:00100000:1.0:1787829939.999836:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 75 00000100:00100000:1.0:1787829939.999841:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+6:2361:x1874675275725952:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829939.999861:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+6:2361:x1874675275725952:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 20us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829939.999867:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 75 00000100:00100000:1.0:1787829939.999884:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275725824 00000100:00100000:1.0:1787829939.999887:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275725824 00000100:00100000:1.0:1787829939.999910:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275726208 00000100:00100000:1.0:1787829939.999913:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275726208 00000100:00100000:1.0:1787829939.999931:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 152 00000100:00100000:1.0:1787829939.999937:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+13:2361:x1874675275725824:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829939.999981:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+13:2361:x1874675275725824:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 45us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829939.999987:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 152 00000100:00100000:1.0:1787829939.999998:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 153 00000100:00100000:1.0:1787829940.000003:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:902200d4-578b-4474-a651-ffe6603128fa+6:2361:x1874675275726208:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829940.000063:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:902200d4-578b-4474-a651-ffe6603128fa+6:2361:x1874675275726208:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 60us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829940.000077:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 153 00000100:00080000:1.0:1787829940.000095:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787829940.000100:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787829940.000102:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787829940.000352:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275725696 00000100:00100000:3.0:1787829940.000357:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275725696 00000100:00100000:3.0:1787829940.000392:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 294 00000100:00100000:3.0:1787829940.000398:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2361:x1874675275725696:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829940.000447:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2361:x1874675275725696:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 50us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829940.000454:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 294 00000001:02000400:1.0:1787829940.677207:0:12317:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 07:25:39 (1787829939) 00010000:00010000:1.0:1787829940.898203:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829941.923107:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829942.117765:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829942.117844:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275726464 00000100:00100000:3.0:1787829942.117853:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275726464 00000100:00100000:3.0:1787829942.117938:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 137 00000100:00100000:3.0:1787829942.117948:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+13:11325:x1874675275726464:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787829942.117969:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829942.117990:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d816a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c895a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829942.118092:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8171 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829942.118109:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8171 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829942.118122:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8171 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829942.118190:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d8178 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829942.118198:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d8178 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829942.118204:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d8178 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829942.118664:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898600/0xc03b4d103c0d817f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829942.118676:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898600/0xc03b4d103c0d817f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829942.118693:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898600/0xc03b4d103c0d817f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829942.118703:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787829942.118912:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8171 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829942.118921:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8171 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829942.118928:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8171 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829942.118933:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164e200 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829942.118937:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8171 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829942.118945:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8171 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829942.118957:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e9b478cc000) 00010000:00010000:3.0:1787829942.118960:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829942.118964:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8171 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829942.118969:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e200/0xc03b4d103c0d8171 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829942.118980:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d8178 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829942.118986:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d8178 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829942.118998:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d8178 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829942.119003:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164e400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829942.119006:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d8178 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829942.119012:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d8178 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829942.119079:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e9b478ccd00) 00010000:00010000:3.0:1787829942.119082:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829942.119085:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d8178 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829942.119090:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e400/0xc03b4d103c0d8178 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829942.119486:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164e600/0xc03b4d103c0d816a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c895a expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829942.119502:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898600/0xc03b4d103c0d817f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c895a expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829942.119509:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e9b45193300) 00010000:00010000:3.0:1787829942.119511:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829942.119514:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74898600, rc 0) 00000100:00100000:3.0:1787829942.119594:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+15:11325:x1874675275726464:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 1648us (1840us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1787829942.119611:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 137 00000100:00080000:1.0:1787829942.119830:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787829942.124412:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829942.124450:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829942.124583:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275726720 00000100:00100000:3.0:1787829942.124593:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275726720 00000100:00100000:3.0:1787829942.124644:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 138 00000100:00100000:3.0:1787829942.124653:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+15:11325:x1874675275726720:12345-192.168.201.51@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787829942.124762:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+15:11325:x1874675275726720:12345-192.168.201.51@tcp:59:lhsmtool_posix.0 Request processed in 109us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829942.124770:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 138 00000100:00100000:2.0:1787829942.124886:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275726592 00000100:00100000:2.0:1787829942.124891:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275726592 00000100:00100000:2.0:1787829942.124938:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 9 00000100:00100000:2.0:1787829942.124946:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe79680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+15:2363:x1874675275726592:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787829942.124957:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829942.124982:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898600/0xc03b4d103c0d817f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c895a expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829942.125000:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e9b45193300) 00010000:00010000:2.0:1787829942.125005:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787829942.125109:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe79680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+14:2363:x1874675275726592:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 163us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829942.125116:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 9 00000040:00080000:1.0:1787829942.435210:0:11648:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787829942.435222:0:11648:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787829942.435709:0:11648:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787829942.435720:0:11648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787829942.946459:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787829943.138369:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787829943.138402:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fb603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284122496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787829943.138501:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829943.138590:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284122496 00000100:00100000:2.0:1787829943.138602:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284122496 00000100:00100000:2.0:1787829943.138680:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787829943.138691:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284122496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787829943.138738:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787829943.138807:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284122496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829943.138816:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1787829943.138840:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787829943.138909:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fb603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284122496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787829943.139151:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b44cc30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874675284122752:0@lo:400:kworker.0 00000100:00100000:0.0:1787829943.139191:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829943.139227:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787829943.139233:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b44cc2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284122624:0@lo:400:kworker.0 00000100:00100000:0.0:1787829943.139266:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829943.139289:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b44cc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284123136:0@lo:400:kworker.0 00000100:00100000:0.0:1787829943.139316:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829943.139347:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284122752 00000100:00100000:0.0:1787829943.139351:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284122752 00000100:00100000:0.0:1787829943.139401:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787829943.139409:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b44cc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1874675284122752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829943.139450:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b44cc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1874675284122752:12345-0@lo:400:kworker.0 Request processed in 41us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829943.139457:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787829943.139479:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284123136 00000100:00100000:0.0:1787829943.139483:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284123136 00000100:00100000:0.0:1787829943.139518:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787829943.139525:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284123136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829943.139559:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284123136:12345-0@lo:400:kworker.0 Request processed in 34us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829943.139566:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787829943.139597:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b44cc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284123136:0@lo:400:kworker.0 00000100:00100000:0.0:1787829943.139607:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b44cc30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874675284122752:0@lo:400:kworker.0 00000100:00100000:1.0:1787829943.139941:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b44cc3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1874675284123008:0@lo:400:kworker.0 00000100:00100000:1.0:1787829943.139982:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829943.140002:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787829943.140008:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b44cc03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1874675284122880:0@lo:400:kworker.0 00000100:00100000:1.0:1787829943.140054:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829943.140085:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284123008 00000100:00100000:1.0:1787829943.140090:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284123008 00000100:00100000:1.0:1787829943.140122:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284122880 00000100:00100000:1.0:1787829943.140124:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284122880 00000100:00100000:1.0:1787829943.140145:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787829943.140152:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874675284123008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829943.140193:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874675284123008:12345-0@lo:400:kworker.0 Request processed in 42us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829943.140210:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787829943.140225:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787829943.140231:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874675284122880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829943.140261:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874675284122880:12345-0@lo:400:kworker.0 Request processed in 30us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829943.140266:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787829943.140300:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b44cc03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1874675284122880:0@lo:400:kworker.0 00000100:00100000:1.0:1787829943.140311:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b44cc3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1874675284123008:0@lo:400:kworker.0 00000100:00100000:2.0:1787829943.140982:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284122624 00000100:00100000:2.0:1787829943.140991:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284122624 00000100:00100000:2.0:1787829943.141067:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787829943.141075:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3279:x1874675284122624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829943.141146:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3279:x1874675284122624:12345-0@lo:400:kworker.0 Request processed in 72us (1879us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829943.141153:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00080000:2.0:1787829943.141191:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787829943.141198:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787829943.141961:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b44cc2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284122624:0@lo:400:kworker.0 00000001:00080000:1.0:1787829943.215265:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000040:00080000:3.0:1787829943.459348:0:11648:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787829943.459373:0:11648:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787829943.461247:0:11648:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1787829943.461264:0:11648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787829943.651336:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787829943.651376:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284123264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787829943.651472:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829943.653070:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284123264 00000100:00100000:2.0:1787829943.653085:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284123264 00000100:00100000:2.0:1787829943.653154:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787829943.653165:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284123264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787829943.653217:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787829943.653311:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284123264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (1838us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829943.653318:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787829943.653399:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284123264:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787829943.976530:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829944.546974:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829944.547493:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275726848 00000100:00100000:3.0:1787829944.547507:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275726848 00000100:00100000:3.0:1787829944.547600:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 139 00000100:00100000:3.0:1787829944.547622:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f383840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+13:11368:x1874675275726848:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:3.0:1787829944.547650:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829944.547680:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898c00/0xc03b4d103c0d818d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8961 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.547767:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d8194 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.547785:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d8194 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.547801:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d8194 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.547839:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d819b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.547847:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d819b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.547854:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d819b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.548342:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d8194 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.548353:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d8194 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.548361:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d8194 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.548367:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74898a00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829944.548372:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d8194 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.548381:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d8194 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.548398:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b45193f00) 00010000:00010000:3.0:1787829944.548401:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829944.548407:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d8194 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.548414:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d8194 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.548438:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d819b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.548444:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d819b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.548450:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d819b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.548456:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74899400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829944.548459:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d819b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.548466:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d819b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.548475:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e9b478cc900) 00010000:00010000:3.0:1787829944.548477:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829944.548479:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d819b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.548484:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d819b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.548527:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898c00/0xc03b4d103c0d818d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8961 expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.548539:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b45193f00) 00010000:00010000:3.0:1787829944.548541:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829944.548551:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898c00/0xc03b4d103c0d818d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8961 expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.548561:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74898c00, rc 0) 00000100:00100000:3.0:1787829944.548657:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f383840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+13:11368:x1874675275726848:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 1046us (1693us total) trans 0 rc 301/301 00000100:00100000:3.0:1787829944.548667:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 139 00000100:00080000:0.0:1787829944.549604:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787829944.562618:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829944.569840:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275727104 00000100:00100000:2.0:1787829944.569868:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275727104 00000100:00100000:0.0:1787829944.577553:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 140 00000100:00100000:0.0:1787829944.577575:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+13:11368:x1874675275727104:12345-192.168.201.51@tcp:36:lfs.0 00010000:00010000:0.0:1787829944.577660:0:7257:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829944.577708:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d7b0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c879a expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.577728:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b45193f00) 00010000:00010000:0.0:1787829944.577735:0:7257:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787829944.578230:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fe00/0xc03b4d103c0d81a2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.579139:0:7257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8163 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8953 expref: 5 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.579152:0:7257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fe00/0xc03b4d103c0d81a2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.579207:0:7257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8163 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8953 expref: 5 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.579227:0:7257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8163 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8953 expref: 5 pid: 5806 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829944.579404:0:7257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f382940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7257:1874675284123392:192.168.201.51@tcp:104: 00000100:00100000:0.0:1787829944.579547:0:7257:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47e280c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787829944.583553:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829944.583728:0:7257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f382940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7257:1874675284123392:192.168.201.51@tcp:104: 00010000:00010000:0.0:1787829944.583767:0:7257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fe00/0xc03b4d103c0d81a2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829944.585182:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275727232 00000100:00100000:1.0:1787829944.585200:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275727232 00010000:00010000:1.0:1787829944.585292:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8163 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8953 expref: 6 pid: 5806 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829944.585361:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 62 00000100:00100000:1.0:1787829944.585374:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:902200d4-578b-4474-a651-ffe6603128fa+6:2363:x1874675275727232:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787829944.585398:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829944.585407:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8163 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8953 expref: 6 pid: 5806 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829944.585432:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8163 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8953 expref: 6 pid: 5806 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829944.585467:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8163 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8953 expref: 6 pid: 5806 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829944.585490:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b45193f00) 00010000:00010000:1.0:1787829944.585498:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fe00/0xc03b4d103c0d81a2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829944.585508:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fe00/0xc03b4d103c0d81a2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829944.585517:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fe00/0xc03b4d103c0d81a2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829944.585545:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829944.585629:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:902200d4-578b-4474-a651-ffe6603128fa+5:2363:x1874675275727232:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 257us (2091us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829944.585639:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 62 00000100:00080000:0.0:1787829944.586218:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787829944.586249:0:7257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fe00/0xc03b4d103c0d81a2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.586272:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fe00/0xc03b4d103c0d81a2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.586305:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d81a9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.586318:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d81a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.586328:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d81a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787829944.588113:0:7257:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787829944.588136:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fe00/0xc03b4d103c0d81a2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.588149:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fe00/0xc03b4d103c0d81a2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.588157:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fe00/0xc03b4d103c0d81a2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.588166:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7fe00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829944.588172:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fe00/0xc03b4d103c0d81a2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.588182:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fe00/0xc03b4d103c0d81a2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.588203:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b45193f00) 00010000:00010000:0.0:1787829944.588207:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787829944.588222:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fe00/0xc03b4d103c0d81a2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.588229:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fe00/0xc03b4d103c0d81a2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787829944.588252:0:7257:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cddf52cc reply state 00000000e15a80ce transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d81a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829944.588262:0:7257:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787829944.588415:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+14:11368:x1874675275727104:12345-192.168.201.51@tcp:36:lfs.0 Request processed in 10838us (25805us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1787829944.588426:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 140 00010000:00010000:0.0:1787829944.603221:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d81a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.603258:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d81a9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.603268:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d81a9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.603276:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7f000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829944.603282:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d81a9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.603292:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d81a9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.603318:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e9b48f25c00) 00010000:00010000:0.0:1787829944.603322:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787829944.603329:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d81a9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.603353:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d81a9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829944.711528:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829944.712302:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275727360 00000100:00100000:0.0:1787829944.712318:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275727360 00000100:00100000:0.0:1787829944.712426:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 141 00000100:00100000:0.0:1787829944.712442:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+13:11376:x1874675275727360:12345-192.168.201.51@tcp:101:lctl.0 00010000:00010000:0.0:1787829944.712478:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829944.712511:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d81b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8968 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.712609:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fe00/0xc03b4d103c0d81b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.712627:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fe00/0xc03b4d103c0d81b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.712642:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fe00/0xc03b4d103c0d81b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787829944.712726:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787829944.712731:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787829944.712768:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fe00/0xc03b4d103c0d81b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.712801:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d81b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8968 expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.712823:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fe00/0xc03b4d103c0d81b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8968 expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.712841:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b48f25c00) 00010000:00010000:0.0:1787829944.712845:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787829944.712850:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7fa7fe00, rc 0) 00000100:00100000:0.0:1787829944.712938:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+14:11376:x1874675275727360:12345-192.168.201.51@tcp:101:lctl.0 Request processed in 500us (1424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829944.712946:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 141 00000100:00100000:2.0:1787829944.823323:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829944.823516:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275727488 00000100:00100000:3.0:1787829944.823530:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275727488 00000100:00100000:3.0:1787829944.823612:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 142 00000100:00100000:3.0:1787829944.823624:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+14:11382:x1874675275727488:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:3.0:1787829944.823653:0:10044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829944.823681:0:10044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898c00/0xc03b4d103c0d81be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c896f expref: -99 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.824247:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d81c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.824268:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d81c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.824283:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d81c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.824299:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d81cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.824307:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d81cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.824346:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d81cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.824518:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898800/0xc03b4d103c0d81d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.824527:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898800/0xc03b4d103c0d81d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.824534:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898800/0xc03b4d103c0d81d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829944.824580:0:10044:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787829944.824585:0:10044:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787829944.824619:0:10044:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898800/0xc03b4d103c0d81d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.824637:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d81c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.824644:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d81c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.824651:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d81c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.824657:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74899400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829944.824662:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d81c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.824671:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d81c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.824695:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b48f25c00) 00010000:00010000:3.0:1787829944.824698:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829944.824704:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d81c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.824710:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d81c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.824723:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d81cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.824728:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d81cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.824734:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d81cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.824740:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74898a00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829944.824743:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d81cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.824748:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d81cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.825875:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e9b478cc900) 00010000:00010000:3.0:1787829944.825879:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829944.825887:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d81cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.825896:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d81cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.827142:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898c00/0xc03b4d103c0d81be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c896f expref: 16 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.827176:0:10044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898800/0xc03b4d103c0d81d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c896f expref: 15 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829944.827186:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:3.0:1787829944.827189:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787829944.827194:0:10044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74898800, rc 0) 00000100:00100000:3.0:1787829944.827300:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+15:11382:x1874675275727488:12345-192.168.201.51@tcp:101:bash.0 Request processed in 3676us (3996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829944.827311:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 142 00000100:00100000:1.0:1787829944.834377:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829944.834500:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275727744 00000100:00100000:2.0:1787829944.834513:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275727744 00000100:00100000:2.0:1787829944.834990:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 143 00000100:00100000:2.0:1787829944.835003:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+15:11382:x1874675275727744:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:2.0:1787829944.835063:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829944.835122:0:7257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d81da lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8976 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829944.835459:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d81e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829944.835478:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d81e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829944.835493:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d81e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829944.835509:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d81e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829944.835516:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d81e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829944.835522:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d81e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787829944.836493:0:7257:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1787829944.836737:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d81ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829944.836752:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d81ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829944.836762:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d81ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829944.836804:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d81e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829944.836831:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d81e1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829944.836838:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d81e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829944.836845:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3ee00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829944.836851:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d81e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829944.836859:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d81e1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829944.836874:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:2.0:1787829944.836877:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829944.836882:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d81e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829944.836889:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d81e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787829944.836907:0:7257:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080a524f7 reply state 00000000a2276409 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d81e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829944.836917:0:7257:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787829944.836962:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d81da lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8976 expref: 18 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829944.836979:0:7257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d81ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8976 expref: 17 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829944.836999:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b455ce600) 00010000:00010000:2.0:1787829944.837002:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787829944.837004:0:7257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3f600, rc 0) 00000100:00100000:2.0:1787829944.838099:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+18:11382:x1874675275727744:12345-192.168.201.51@tcp:101:bash.0 Request processed in 3087us (4082us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787829944.838404:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 143 00010000:00010000:1.0:1787829944.842742:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d81e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829944.842766:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d81e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829944.842774:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d81e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829944.842794:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f800 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829944.842801:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d81e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829944.842810:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d81e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829944.842832:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e9b455ce200) 00010000:00010000:1.0:1787829944.842835:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829944.842841:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d81e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829944.842849:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d81e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829944.845766:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829944.845867:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275727872 00000100:00100000:2.0:1787829944.845881:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275727872 00000100:00100000:2.0:1787829944.845987:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 47 00000100:00100000:2.0:1787829944.846000:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+5:2361:x1874675275727872:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:2.0:1787829944.846055:0:8603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829944.846084:0:8603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004da18a5b/0xc03b4d103c0d81fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c897d expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787829944.846566:0:8603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787829944.846597:0:8603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=324s v=(0 0) 00010000:00010000:2.0:1787829944.846603:0:8603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787829944.846617:0:8603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004da18a5b/0xc03b4d103c0d81fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c897d expref: 6 pid: 8603 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829944.846642:0:8603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004da18a5b/0xc03b4d103c0d81fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c897d expref: 6 pid: 8603 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829944.846659:0:8603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3fa00, rc 0) 00000100:00100000:2.0:1787829944.846744:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+6:2361:x1874675275727872:12345-192.168.201.51@tcp:101:bash.0 Request processed in 747us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829944.846772:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 47 00000100:00080000:0.0:1787829944.846879:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787829944.850751:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829944.850855:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275728000 00000100:00100000:0.0:1787829944.850867:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275728000 00000100:00100000:0.0:1787829944.850945:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 48 00000100:00100000:0.0:1787829944.850958:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa44780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+6:11382:x1874675275728000:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:0.0:1787829944.850982:0:6651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829944.851006:0:6651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fde51639/0xc03b4d103c0d8204 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8984 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.851669:0:6651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004da18a5b/0xc03b4d103c0d81fd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c897d expref: 7 pid: 8603 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.851682:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787829944.851688:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787829944.851694:0:6651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fde51639/0xc03b4d103c0d8204 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8984 expref: 7 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.851740:0:6651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004da18a5b/0xc03b4d103c0d81fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c897d expref: 7 pid: 8603 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.851781:0:6651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004da18a5b/0xc03b4d103c0d81fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c897d expref: 7 pid: 8603 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829944.851800:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f382940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6651:1874675284123520:192.168.201.51@tcp:104: 00000100:00100000:0.0:1787829944.851949:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47e280c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787829944.855418:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f382940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6651:1874675284123520:192.168.201.51@tcp:104: 00010000:00010000:0.0:1787829944.855472:0:6651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fde51639/0xc03b4d103c0d8204 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c8984 expref: 7 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.855501:0:6651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7fa7fc00, rc 0) 00000100:00100000:0.0:1787829944.855639:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa44780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+7:11382:x1874675275728000:12345-192.168.201.51@tcp:101:bash.0 Request processed in 4683us (4900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829944.855650:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 48 00000100:00100000:1.0:1787829944.855880:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829944.856063:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275728128 00000100:00100000:2.0:1787829944.856073:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275728128 00010000:00010000:2.0:1787829944.856127:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004da18a5b/0xc03b4d103c0d81fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c897d expref: 7 pid: 8603 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829944.856164:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 63 00000100:00100000:2.0:1787829944.856175:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52387c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+7:2362:x1874675275728128:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787829944.856195:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829944.856227:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004da18a5b/0xc03b4d103c0d81fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c897d expref: 7 pid: 8603 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829944.856254:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004da18a5b/0xc03b4d103c0d81fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c897d expref: 7 pid: 8603 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829944.856286:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004da18a5b/0xc03b4d103c0d81fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c897d expref: 7 pid: 8603 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829944.856302:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787829944.856307:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787829944.856317:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fde51639/0xc03b4d103c0d8204 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c8984 expref: 6 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829944.856337:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fde51639/0xc03b4d103c0d8204 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c8984 expref: 6 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829944.856405:0:5790:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fde51639/0xc03b4d103c0d8204 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c8984 expref: 6 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829944.856423:0:5790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fb612c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5790:1874675284123648:192.168.201.51@tcp:105: 00000100:00100000:2.0:1787829944.857766:0:5790:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fa62540 going to sleep for 11 seconds 00000100:00100000:1.0:1787829944.864086:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829944.864306:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275728384 00000100:00100000:0.0:1787829944.864320:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275728384 00000100:00100000:0.0:1787829944.864411:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 36 00000100:00100000:0.0:1787829944.864425:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+17:11382:x1874675275728384:12345-192.168.201.51@tcp:35:bash.0 00000100:00100000:0.0:1787829944.864917:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+18:11382:x1874675275728384:12345-192.168.201.51@tcp:35:bash.0 Request processed in 493us (847us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1787829944.864926:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 36 00000100:00100000:2.0:1787829944.865524:0:5790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fb612c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5790:1874675284123648:192.168.201.51@tcp:105: 00010000:00010000:2.0:1787829944.865556:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787829944.865597:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52387c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+6:2362:x1874675275728128:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 9424us (9719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829944.865608:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 63 00000100:00100000:1.0:1787829944.946816:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829944.947125:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275728640 00000100:00100000:0.0:1787829944.947148:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275728640 00000100:00100000:0.0:1787829944.947238:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 144 00000100:00100000:0.0:1787829944.947253:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52389680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+18:11392:x1874675275728640:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:0.0:1787829944.947321:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829944.947366:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e800/0xc03b4d103c0d820b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c898b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787829944.947534:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787829944.947703:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e800/0xc03b4d103c0d820b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c898b expref: 20 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.947722:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b48f25c00) 00010000:00010000:0.0:1787829944.947725:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787829944.947732:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e800/0xc03b4d103c0d820b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c898b expref: 20 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829944.947751:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7fa7e800, rc 0) 00000100:00100000:0.0:1787829944.948201:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52389680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+19:11392:x1874675275728640:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 948us (1395us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1787829944.948212:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 144 00000100:00100000:3.0:1787829944.952974:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829944.954505:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275728896 00000100:00100000:0.0:1787829944.954520:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275728896 00000100:00100000:0.0:1787829944.954593:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 37 00000100:00100000:0.0:1787829944.954601:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+19:11392:x1874675275728896:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:0.0:1787829944.954972:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+20:11392:x1874675275728896:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 371us (2013us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1787829944.954978:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 37 00010000:00010000:2.0:1787829944.994287:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787829945.026519:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829945.027108:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275729024 00000100:00100000:1.0:1787829945.027122:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275729024 00000100:00100000:1.0:1787829945.027210:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 145 00000100:00100000:1.0:1787829945.027222:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+20:11398:x1874675275729024:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:1.0:1787829945.027256:0:10044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829945.027284:0:10044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8219 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8992 expref: -99 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.027429:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8220 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.027449:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8220 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.027463:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8220 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787829945.027548:0:10044:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787829945.027553:0:10044:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787829945.027582:0:10044:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8220 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.027617:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8219 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8992 expref: 22 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.027640:0:10044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8220 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8992 expref: 21 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.027651:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:1.0:1787829945.027654:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787829945.027659:0:10044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feef000, rc 0) 00000100:00100000:1.0:1787829945.028510:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+21:11398:x1874675275729024:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 1281us (1994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829945.028521:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 145 00000100:00100000:2.0:1787829945.036869:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829945.037214:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275729280 00000100:00100000:3.0:1787829945.037227:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275729280 00000100:00100000:3.0:1787829945.037307:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 146 00000100:00100000:3.0:1787829945.037335:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+21:11398:x1874675275729280:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:3.0:1787829945.037365:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829945.037395:0:7257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d8227 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8999 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829945.037524:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898c00/0xc03b4d103c0d822e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829945.037539:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898c00/0xc03b4d103c0d822e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829945.037568:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898c00/0xc03b4d103c0d822e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829945.037579:0:7257:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787829945.037836:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d8227 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8999 expref: 24 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829945.037853:0:7257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898c00/0xc03b4d103c0d822e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8999 expref: 23 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829945.037860:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b455ce600) 00010000:00010000:3.0:1787829945.037863:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787829945.037865:0:7257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74898c00, rc 0) 00000100:00100000:3.0:1787829945.037931:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+23:11398:x1874675275729280:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 616us (1077us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1787829945.037937:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 146 00000100:00100000:0.0:1787829945.047579:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829945.048012:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829945.048186:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275729536 00000100:00100000:2.0:1787829945.048199:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275729536 00000100:00100000:2.0:1787829945.048276:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 147 00000100:00100000:2.0:1787829945.048288:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f382940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+23:11398:x1874675275729536:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:2.0:1787829945.048525:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829945.048557:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d823c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c89a0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.048687:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d8243 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.048719:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d8243 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.048757:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d8243 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787829945.048773:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787829945.048922:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d823c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89a0 expref: 26 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.048939:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d8243 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89a0 expref: 25 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.048946:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b455ce600) 00010000:00010000:2.0:1787829945.048949:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787829945.048951:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3ec00, rc 0) 00000100:00100000:2.0:1787829945.049104:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f382940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+25:11398:x1874675275729536:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 820us (1541us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787829945.049112:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 147 00000100:00100000:3.0:1787829945.049832:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275729664 00000100:00100000:3.0:1787829945.049842:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275729664 00000100:00100000:3.0:1787829945.050539:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 10 00000100:00100000:3.0:1787829945.050554:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5238a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6abf229-545c-43fd-8dee-d9adf582be48+25:2363:x1874675275729664:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787829945.050573:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829945.050601:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898c00/0xc03b4d103c0d822e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8999 expref: 25 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829945.050623:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b455ce600) 00010000:00010000:3.0:1787829945.050629:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787829945.050719:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5238a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6abf229-545c-43fd-8dee-d9adf582be48+24:2363:x1874675275729664:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 170us (2709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829945.050727:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 10 00000100:00100000:0.0:1787829945.064474:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829945.064626:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275729792 00000100:00100000:2.0:1787829945.064805:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275729792 00000100:00100000:2.0:1787829945.064931:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 49 00000100:00100000:2.0:1787829945.064944:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f383480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+6:2362:x1874675275729792:12345-192.168.201.51@tcp:1:lfs.0 00010000:00010000:2.0:1787829945.065008:0:8603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8251 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.065074:0:8603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fde51639/0xc03b4d103c0d8204 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c8984 expref: 6 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.065084:0:8603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787829945.065097:0:8603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787829945.065103:0:8603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8251 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.065501:0:8603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fde51639/0xc03b4d103c0d8204 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8984 expref: 6 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.065521:0:8603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fde51639/0xc03b4d103c0d8204 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8984 expref: 6 pid: 6651 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829945.065540:0:8603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fb621c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8603:1874675284123776:192.168.201.51@tcp:104: 00000100:00100000:2.0:1787829945.066165:0:8603:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fa62540 going to sleep for 11 seconds 00000100:00100000:0.0:1787829945.070655:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829945.070835:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275729920 00000100:00100000:1.0:1787829945.070877:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275729920 00002000:00100000:1.0:1787829945.070944:0:6656:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9e9b7f383c00 x1874675275729920/t0(0) o4->b6abf229-545c-43fd-8dee-d9adf582be48@192.168.201.51@tcp:526/0 lens 504/0 e 0 to 0 dl 1787829956 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787829945.070956:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e9b7f383c00 with x1874675275729920 ext(0->12) 00010000:00010000:1.0:1787829945.070967:0:6656:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fde51639/0xc03b4d103c0d8204 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8984 expref: 7 pid: 6651 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.070987:0:6656:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fde51639/0xc03b4d103c0d8204 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8984 expref: 7 pid: 6651 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787829945.070995:0:6656:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e9b7f383c00 00000100:00100000:1.0:1787829945.071066:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 2 00000100:00100000:1.0:1787829945.071077:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f383c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b6abf229-545c-43fd-8dee-d9adf582be48+7:2363:x1874675275729920:12345-192.168.201.51@tcp:4:lfs.0 00000100:00100000:1.0:1787829945.071793:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f383c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b6abf229-545c-43fd-8dee-d9adf582be48+9:2363:x1874675275729920:12345-192.168.201.51@tcp:4:lfs.0 Request processed in 714us (1159us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787829945.071803:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 2 00002000:00100000:1.0:1787829945.071812:0:6656:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9e9b7f383c00 x1874675275729920/t4294967305(0) o4->b6abf229-545c-43fd-8dee-d9adf582be48@192.168.201.51@tcp:526/0 lens 504/448 e 0 to 0 dl 1787829956 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787829945.071820:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e9b7f383c00 with x1874675275729920 ext(0->12) 00010000:00010000:1.0:1787829945.071829:0:6656:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fde51639/0xc03b4d103c0d8204 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8984 expref: 9 pid: 6651 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.071846:0:6656:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fde51639/0xc03b4d103c0d8204 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8984 expref: 9 pid: 6651 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787829945.071867:0:6656:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e9b7f383c00 00000100:00100000:2.0:1787829945.077555:0:8603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fb621c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8603:1874675284123776:192.168.201.51@tcp:104: 00010000:00010000:2.0:1787829945.077605:0:8603:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8251 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829945.079459:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829945.080094:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275730048 00000100:00100000:0.0:1787829945.080299:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275730048 00010000:00010000:0.0:1787829945.080371:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fde51639/0xc03b4d103c0d8204 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8984 expref: 9 pid: 6651 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829945.080431:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 64 00000100:00100000:0.0:1787829945.080444:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b523892c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+9:2362:x1874675275730048:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787829945.080466:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787829945.080493:0:5792:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787829945.080497:0:5792:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787829945 00002000:00010000:0.0:1787829945.080500:0:5792:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787829945 00002000:00010000:0.0:1787829945.080503:0:5792:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787829945 00010000:00010000:0.0:1787829945.080510:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fde51639/0xc03b4d103c0d8204 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8984 expref: 9 pid: 6651 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829945.080527:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fde51639/0xc03b4d103c0d8204 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8984 expref: 9 pid: 6651 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829945.080556:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fde51639/0xc03b4d103c0d8204 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8984 expref: 9 pid: 6651 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829945.080577:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787829945.080582:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787829945.080589:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8251 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829945.080625:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8251 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829945.080926:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829945.081081:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b523892c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+8:2362:x1874675275730048:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 637us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829945.081090:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 64 00010000:00010000:2.0:1787829945.083483:0:8603:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8251 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.083509:0:8603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8251 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.083556:0:8603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8251 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.083565:0:8603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8251 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.083598:0:8603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8251 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.083606:0:8603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3ee00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:2.0:1787829945.083611:0:8603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8251 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.083620:0:8603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8251 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.083756:0:8603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8251 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.083766:0:8603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8251 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829945.084151:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f383480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+7:2362:x1874675275729792:12345-192.168.201.51@tcp:1:lfs.0 Request processed in 19203us (19793us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829945.084163:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 49 00000100:00100000:1.0:1787829945.093497:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829945.094560:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275730304 00000100:00100000:0.0:1787829945.094576:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275730304 00000100:00100000:0.0:1787829945.094663:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 38 00000100:00100000:0.0:1787829945.094797:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b50360850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+24:11398:x1874675275730304:12345-192.168.201.51@tcp:35:lfs.0 00000004:00010000:0.0:1787829945.094901:0:5808:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d8243 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89a0 expref: 24 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787829945.095442:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1787829945.095495:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1787829945.096906:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1787829945.097432:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8258 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829945.097458:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d81ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8976 expref: 28 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829945.097469:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8258 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829945.097522:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d81ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8976 expref: 28 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829945.097557:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d81ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8976 expref: 28 pid: 7257 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829945.097576:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f380000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5808:1874675284123904:192.168.201.51@tcp:104: 00000100:00100000:0.0:1787829945.097960:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47f4b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787829945.104967:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f380000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5808:1874675284123904:192.168.201.51@tcp:104: 00010000:00010000:0.0:1787829945.105066:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8258 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829945.105497:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829945.105594:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275730432 00000100:00100000:1.0:1787829945.105604:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275730432 00010000:00010000:1.0:1787829945.105882:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d81ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8976 expref: 29 pid: 7257 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829945.106053:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 65 00000100:00100000:1.0:1787829945.106065:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b4fae7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+29:2363:x1874675275730432:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787829945.106084:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829945.106092:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d81ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8976 expref: 29 pid: 7257 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.106114:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d81ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8976 expref: 29 pid: 7257 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.106423:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d81ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8976 expref: 29 pid: 7257 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.106444:0:8409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b455ce600) 00010000:00010000:1.0:1787829945.106450:0:8409:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8258 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.106461:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8258 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.106491:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8258 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.106529:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829945.106604:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b4fae7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+28:2363:x1874675275730432:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 541us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829945.106614:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 65 00010000:00010000:0.0:1787829945.106824:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8258 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829945.106832:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8258 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787829945.107047:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1787829945.108248:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1787829945.108427:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f380000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1874675284124032:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787829945.108514:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829945.108584:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284124032 00000100:00100000:0.0:1787829945.108593:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284124032 00000100:00100000:0.0:1787829945.109185:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787829945.109199:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5808:x1874675284124032:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787829945.109616:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5808:x1874675284124032:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 420us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829945.109625:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787829945.110048:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787829945.110066:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47e28a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787829945.110104:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f380000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1874675284124032:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787829945.112412:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1787829945.112539:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fe78000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1874675284124160:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787829945.112623:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829945.114122:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47f4b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787829945.114790:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284124160 00000100:00100000:3.0:1787829945.114808:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284124160 00000100:00100000:3.0:1787829945.114889:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787829945.114901:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5808:x1874675284124160:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787829945.118827:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829945.118888:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829945.118933:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829945.118967:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275730688 00000100:00100000:2.0:1787829945.118968:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275730560 00000100:00100000:2.0:1787829945.118979:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275730560 00000100:00100000:1.0:1787829945.118979:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275730688 00000100:00100000:2.0:1787829945.119064:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 296 00000100:00100000:2.0:1787829945.119096:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2360:x1874675275730560:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829945.119175:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2360:x1874675275730560:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 82us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829945.119184:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 296 00000100:00100000:1.0:1787829945.120077:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 77 00000100:00100000:1.0:1787829945.120090:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:2361:x1874675275730688:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829945.120342:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275730816 00000100:00100000:2.0:1787829945.120351:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275730816 00000100:00100000:2.0:1787829945.120392:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 157 00000100:00100000:2.0:1787829945.120399:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:902200d4-578b-4474-a651-ffe6603128fa+5:2360:x1874675275730816:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829945.120459:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:902200d4-578b-4474-a651-ffe6603128fa+5:2360:x1874675275730816:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 60us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829945.120466:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 157 00000100:00100000:1.0:1787829945.122800:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+6:2361:x1874675275730688:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 1571us (2961us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829945.122826:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 77 00000100:00080000:1.0:1787829945.122883:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787829945.124946:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5808:x1874675284124160:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 10035us (12310us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787829945.124961:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787829945.125399:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fe78000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1874675284124160:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787829945.125547:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1787829945.125646:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8258 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829945.125659:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8258 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829945.126818:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8258 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829945.126828:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7fc00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829945.126834:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8258 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829945.126843:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8258 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829945.126877:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b455ce600) 00010000:00010000:0.0:1787829945.126880:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787829945.126886:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8258 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829945.126893:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8258 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787829945.127825:0:5808:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787829945.128008:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1787829945.128068:0:5808:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 325029050154ns, next at 326029046066ns, rc = 0 00000001:00080000:0.0:1787829945.128081:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1787829945.129122:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b455ce600) 00010000:00010000:0.0:1787829945.129396:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787829945.129413:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d8243 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89a0 expref: 32 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829945.129610:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b50360850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+31:11398:x1874675275730304:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 34816us (36126us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1787829945.129623:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 38 00000020:00080000:0.0:1787829945.129630:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787829945.133808:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829945.133908:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275730944 00000100:00100000:1.0:1787829945.133922:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275730944 00000100:00100000:1.0:1787829945.133998:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 148 00000100:00100000:1.0:1787829945.134010:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+31:11398:x1874675275730944:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:1.0:1787829945.134083:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829945.134123:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d825f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c89a7 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.134740:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d825f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89a7 expref: 32 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.134759:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d825f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89a7 expref: 32 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.134807:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7100) 00010000:00010000:1.0:1787829945.134810:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787829945.134815:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feeea00, rc 0) 00000100:00100000:1.0:1787829945.134995:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+32:11398:x1874675275730944:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 986us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829945.135003:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 148 00000100:00100000:1.0:1787829945.140533:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829945.140654:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275731200 00000100:00100000:2.0:1787829945.140739:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275731200 00000100:00100000:2.0:1787829945.140872:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 39 00000100:00100000:2.0:1787829945.140885:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5238a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+32:11398:x1874675275731200:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:2.0:1787829945.141282:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5238a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+33:11398:x1874675275731200:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 398us (762us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1787829945.141291:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 39 00000100:00100000:2.0:1787829945.212740:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829945.212999:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275731456 00000100:00100000:0.0:1787829945.213011:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275731456 00000100:00100000:1.0:1787829945.213632:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 149 00000100:00100000:1.0:1787829945.213645:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+33:11408:x1874675275731456:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:1.0:1787829945.213736:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829945.213764:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d8266 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c89ae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787829945.213923:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787829945.214099:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d8266 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89ae expref: 35 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.214134:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b48f25c00) 00010000:00010000:1.0:1787829945.214139:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787829945.214145:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d8266 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89ae expref: 35 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.214162:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feee200, rc 0) 00000100:00100000:1.0:1787829945.214595:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+34:11408:x1874675275731456:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 950us (1867us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1787829945.214628:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 149 00000100:00100000:3.0:1787829945.222433:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829945.222541:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275731584 00000100:00100000:2.0:1787829945.222553:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275731584 00000100:00100000:2.0:1787829945.222689:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 150 00000100:00100000:2.0:1787829945.222703:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+34:11408:x1874675275731584:12345-192.168.201.51@tcp:34:lfs.0 00010000:00010000:2.0:1787829945.222818:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8274 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.222858:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8274 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.222884:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8274 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.222903:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d827b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.222919:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d827b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.222926:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d827b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.223118:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d8282 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.223134:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d8282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.223143:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d8282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787829945.223196:0:7257:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d8282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.223213:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8274 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.223220:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8274 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.223248:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8274 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.223254:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829945.223259:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8274 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.223267:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8274 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.223281:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:2.0:1787829945.223284:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829945.223290:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8274 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.223298:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8274 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.223320:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d827b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.223339:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d827b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.223345:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d827b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.223351:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829945.223354:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d827b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.223372:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d827b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.223381:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e9b455ce700) 00010000:00010000:2.0:1787829945.223384:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829945.223387:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d827b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.223393:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d827b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.223410:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d8282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.223416:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d8282 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.223422:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d8282 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.223427:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3ea00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829945.223430:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d8282 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.223436:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d8282 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.223443:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7100) 00010000:00010000:2.0:1787829945.223445:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829945.223448:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d8282 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.223465:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d8282 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829945.223556:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+34:11408:x1874675275731584:12345-192.168.201.51@tcp:34:lfs.0 Request processed in 856us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829945.223566:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 150 00000100:00100000:3.0:1787829945.227844:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829945.228120:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275731840 00000100:00100000:0.0:1787829945.228139:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275731840 00000100:00100000:0.0:1787829945.228271:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 40 00000100:00100000:0.0:1787829945.228282:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+34:11408:x1874675275731840:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:0.0:1787829945.228634:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+35:11408:x1874675275731840:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 353us (802us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787829945.228643:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 40 00000100:00100000:1.0:1787829945.263214:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829945.263342:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275732096 00000100:00100000:2.0:1787829945.263356:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275732096 00000100:00100000:2.0:1787829945.263430:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 151 00000100:00100000:2.0:1787829945.263442:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b523892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+35:11411:x1874675275732096:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:2.0:1787829945.263476:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829945.263504:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d8289 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c89b5 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.263598:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d8290 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.263616:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d8290 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.263629:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d8290 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.263646:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8297 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.263653:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8297 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.263756:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8297 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.264204:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d829e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.264215:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d829e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.264223:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d829e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787829945.264233:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787829945.264369:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d8290 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.264378:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d8290 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.264385:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d8290 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.264392:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829945.264397:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d8290 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.264405:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d8290 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.264420:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:2.0:1787829945.264424:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829945.264439:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d8290 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.264446:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d8290 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.264463:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8297 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.264470:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8297 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.264476:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8297 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.264482:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829945.264485:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8297 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.264491:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8297 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.264500:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e9b455ce700) 00010000:00010000:2.0:1787829945.264502:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829945.264505:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8297 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.264510:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8297 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.264561:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d8289 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89b5 expref: 38 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.264592:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d829e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89b5 expref: 37 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.264599:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7100) 00010000:00010000:2.0:1787829945.264601:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787829945.264603:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3e000, rc 0) 00000100:00100000:2.0:1787829945.264880:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b523892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+37:11411:x1874675275732096:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 1440us (1924us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1787829945.264889:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 151 00000100:00100000:3.0:1787829945.268433:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829945.268549:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275732224 00000100:00100000:1.0:1787829945.268562:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275732224 00000100:00100000:1.0:1787829945.268635:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 152 00000100:00100000:1.0:1787829945.268647:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+37:11411:x1874675275732224:12345-192.168.201.51@tcp:54:lfs.0 00010000:00010000:1.0:1787829945.268817:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d82ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.268839:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d82ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.268854:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d82ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.268900:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d82ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.268905:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d82ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.268911:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d82ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.268915:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feeec00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829945.268919:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d82ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.268925:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d82ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.268964:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7100) 00010000:00010000:1.0:1787829945.268967:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787829945.268971:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d82ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.268976:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d82ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829945.270516:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+37:11411:x1874675275732224:12345-192.168.201.51@tcp:54:lfs.0 Request processed in 1857us (2083us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829945.270533:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 152 00000100:00100000:3.0:1787829945.272332:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829945.272406:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275732480 00000100:00100000:2.0:1787829945.272418:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275732480 00000100:00100000:2.0:1787829945.272546:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 41 00000100:00100000:2.0:1787829945.272559:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+37:11411:x1874675275732480:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:2.0:1787829945.272855:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+38:11411:x1874675275732480:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 297us (541us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1787829945.272871:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 41 00000100:00100000:2.0:1787829945.488554:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829945.488698:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275732736 00000100:00100000:3.0:1787829945.488713:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275732736 00000100:00100000:3.0:1787829945.488922:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 153 00000100:00100000:3.0:1787829945.488936:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+38:11442:x1874675275732736:12345-192.168.201.51@tcp:101:cat.0 00010000:00010000:3.0:1787829945.489256:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829945.489288:0:7257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d82b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c89bc expref: -99 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829945.489447:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898c00/0xc03b4d103c0d82ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829945.489463:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898c00/0xc03b4d103c0d82ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829945.489494:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898c00/0xc03b4d103c0d82ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829945.489506:0:7257:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787829945.489642:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d82b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89bc expref: 41 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829945.489662:0:7257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898c00/0xc03b4d103c0d82ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89bc expref: 40 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829945.489671:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7100) 00010000:00010000:3.0:1787829945.489675:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787829945.489679:0:7257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74898c00, rc 0) 00000100:00100000:3.0:1787829945.489763:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+40:11442:x1874675275732736:12345-192.168.201.51@tcp:101:cat.0 Request processed in 831us (1225us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1787829945.489772:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 153 00000100:00100000:3.0:1787829945.493816:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829945.494475:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275732992 00000100:00100000:0.0:1787829945.494489:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275732992 00000100:00100000:0.0:1787829945.494563:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 42 00000100:00100000:0.0:1787829945.494575:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+40:11442:x1874675275732992:12345-192.168.201.51@tcp:35:cat.0 00000100:00100000:3.0:1787829945.494901:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829945.495798:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+41:11442:x1874675275732992:12345-192.168.201.51@tcp:35:cat.0 Request processed in 1220us (1992us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1787829945.495811:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 42 00000100:00100000:1.0:1787829945.496301:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275733120 00000100:00100000:1.0:1787829945.496309:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275733120 00000100:00100000:1.0:1787829945.496422:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 11 00000100:00100000:1.0:1787829945.496431:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+41:2362:x1874675275733120:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787829945.496447:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829945.496478:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898c00/0xc03b4d103c0d82ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89bc expref: 41 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.496500:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7100) 00010000:00010000:1.0:1787829945.496511:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829945.496547:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+40:2362:x1874675275733120:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 116us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829945.496554:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 11 00000100:00100000:3.0:1787829945.546192:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829945.546258:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275733376 00000100:00100000:2.0:1787829945.546270:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275733376 00000100:00100000:2.0:1787829945.546496:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 154 00000100:00100000:2.0:1787829945.546509:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+40:11448:x1874675275733376:12345-192.168.201.51@tcp:101:dd.0 00010000:00010000:2.0:1787829945.546543:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829945.546547:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787829945.546583:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8220 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8992 expref: 40 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.546627:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:2.0:1787829945.546632:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787829945.546648:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d82c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c89c3 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.546762:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d82cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.546777:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d829e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89b5 expref: 40 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.546787:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d82cf lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.546826:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d829e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c89b5 expref: 40 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.546841:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d829e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c89b5 expref: 40 pid: 5806 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829945.546857:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1874675284124288:192.168.201.51@tcp:104: 00000100:00100000:2.0:1787829945.546990:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fa62cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787829945.550185:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829945.550502:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275733504 00000100:00100000:1.0:1787829945.550513:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275733504 00010000:00010000:1.0:1787829945.550567:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d829e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c89b5 expref: 41 pid: 5806 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829945.550636:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 66 00000100:00100000:1.0:1787829945.550648:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7489fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6abf229-545c-43fd-8dee-d9adf582be48+41:2362:x1874675275733504:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787829945.550672:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829945.550679:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d829e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c89b5 expref: 41 pid: 5806 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.550695:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d829e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c89b5 expref: 41 pid: 5806 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.550725:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7100) 00010000:00010000:1.0:1787829945.550730:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d82cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.550738:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d82cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.550743:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d82cf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.550762:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829945.550899:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7489fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6abf229-545c-43fd-8dee-d9adf582be48+41:2362:x1874675275733504:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 253us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829945.550906:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 66 00010000:00010000:2.0:1787829945.551130:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d829e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c89b5 expref: 40 pid: 5806 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829945.551146:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1874675284124288:192.168.201.51@tcp:104: 00010000:00010000:2.0:1787829945.551179:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d82cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.551187:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d82cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.551196:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d82cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787829945.551218:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787829945.551415:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d82c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89c3 expref: 41 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.551431:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d82cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89c3 expref: 40 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.551439:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7100) 00010000:00010000:2.0:1787829945.551442:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787829945.551445:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3f400, rc 0) 00000100:00100000:2.0:1787829945.551476:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+40:11448:x1874675275733376:12345-192.168.201.51@tcp:101:dd.0 Request processed in 4972us (5299us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1787829945.551484:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 154 00000100:00100000:3.0:1787829945.554455:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829945.554571:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275733760 00000100:00100000:1.0:1787829945.554581:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275733760 00000100:00100000:1.0:1787829945.554634:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 155 00000100:00100000:1.0:1787829945.554644:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7489c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+40:11448:x1874675275733760:12345-192.168.201.51@tcp:36:dd.0 00010000:00010000:1.0:1787829945.554997:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d82dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.555050:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d82dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.555064:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d82dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787829945.555120:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1787829945.555139:0:5805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e098ba7d reply state 00000000349fcca0 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d82dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829945.555149:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787829945.555300:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7489c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+43:11448:x1874675275733760:12345-192.168.201.51@tcp:36:dd.0 Request processed in 657us (855us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1787829945.555309:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 155 00000020:00080000:1.0:1787829945.555315:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787829945.557254:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d82dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.557273:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d82dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.557281:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d82dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.557309:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feeec00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829945.557315:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d82dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.557334:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d82dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.557354:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7100) 00010000:00010000:2.0:1787829945.557357:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829945.557364:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d82dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.557371:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d82dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829945.769973:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829945.770170:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275733888 00000100:00100000:2.0:1787829945.770181:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275733888 00000100:00100000:2.0:1787829945.770244:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 156 00000100:00100000:2.0:1787829945.770255:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7489de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+42:11463:x1874675275733888:12345-192.168.201.51@tcp:101:stat.0 00010000:00010000:2.0:1787829945.770292:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829945.771671:0:7257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d82e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c89ca expref: -99 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.771896:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d82eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.771916:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d82eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.771930:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d82eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.771965:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d82f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.771971:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d82f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.771976:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d82f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.772096:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d82f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.772106:0:7257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d82cf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89c3 expref: 43 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.772112:0:7257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d82f9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.772147:0:7257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d82cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c89c3 expref: 43 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.772161:0:7257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d82cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c89c3 expref: 43 pid: 5806 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829945.772174:0:7257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b75cd0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7257:1874675284124416:192.168.201.51@tcp:104: 00000100:00100000:2.0:1787829945.772438:0:7257:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fa620c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787829945.777221:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829945.777293:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275734144 00000100:00100000:1.0:1787829945.777305:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275734144 00000100:00100000:2.0:1787829945.777365:0:7257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b75cd0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7257:1874675284124416:192.168.201.51@tcp:104: 00010000:00010000:2.0:1787829945.777407:0:7257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d82f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829945.777426:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 43 00000100:00100000:1.0:1787829945.777438:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b44cc2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+44:5598:x1874675275734144:12345-192.168.201.51@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787829945.777902:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b44cc2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+45:5598:x1874675275734144:12345-192.168.201.51@tcp:35:ldlm_bl.0 Request processed in 464us (690us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1787829945.777913:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 43 00000100:00100000:3.0:1787829945.780541:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829945.780622:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275734272 00000100:00100000:0.0:1787829945.780633:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275734272 00010000:00010000:0.0:1787829945.780877:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d82cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c89c3 expref: 45 pid: 5806 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829945.781242:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 67 00000100:00100000:0.0:1787829945.781255:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7489f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+45:2362:x1874675275734272:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787829945.781276:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829945.781285:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d82cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c89c3 expref: 45 pid: 5806 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829945.781301:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d82cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c89c3 expref: 45 pid: 5806 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829945.781346:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d82cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c89c3 expref: 45 pid: 5806 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829945.781367:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7100) 00010000:00010000:0.0:1787829945.781373:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d82f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829945.781384:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d82f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829945.781416:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d82f9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829945.781587:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829945.781676:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7489f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+44:2362:x1874675275734272:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 424us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829945.781686:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 67 00010000:00010000:2.0:1787829945.782354:0:7257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d82f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.782368:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d82f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787829945.782430:0:7257:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787829945.782436:0:7257:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787829945.782466:0:7257:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d82f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.782484:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d82f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.782497:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d82eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.782505:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d82eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.782513:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d82eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.782524:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3e000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829945.782528:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d82eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.782536:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d82eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.782549:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:2.0:1787829945.782567:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829945.782573:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d82eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.782580:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d82eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.782597:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d82f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.782603:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d82f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.782609:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d82f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.782614:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829945.782616:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d82f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.782622:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d82f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.782629:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e9b455ce700) 00010000:00010000:2.0:1787829945.782631:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829945.782634:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d82f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.782752:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d82f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.782872:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d82e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89ca expref: 44 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.782903:0:7257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d82f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89ca expref: 43 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.782911:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7100) 00010000:00010000:2.0:1787829945.782913:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787829945.782915:0:7257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3e800, rc 0) 00000100:00100000:2.0:1787829945.789254:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7489de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+43:11463:x1874675275733888:12345-192.168.201.51@tcp:101:stat.0 Request processed in 18982us (19273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829945.789270:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 156 00000100:00100000:3.0:1787829945.855827:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829945.856924:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275734528 00000100:00100000:2.0:1787829945.856941:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275734528 00000100:00100000:2.0:1787829945.857130:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 157 00000100:00100000:2.0:1787829945.857144:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b42c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+43:11469:x1874675275734528:12345-192.168.201.51@tcp:36:truncate.0 00010000:00010000:2.0:1787829945.857340:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829945.857377:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d82f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89ca expref: 43 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.857463:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7100) 00010000:00010000:2.0:1787829945.857470:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787829945.859777:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d8300 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.859807:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d8300 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829945.859821:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d8300 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787829945.859948:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1787829945.859976:0:5806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c91a5f36 reply state 00000000038202c9 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d8300 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829945.859987:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787829945.860164:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b42c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+45:11469:x1874675275734528:12345-192.168.201.51@tcp:36:truncate.0 Request processed in 3016us (4346us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1787829945.860175:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 157 00000020:00080000:2.0:1787829945.860182:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787829945.864062:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d8300 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.864089:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d8300 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.864113:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d8300 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.864121:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3ea00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829945.864126:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d8300 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.864136:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d8300 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.864160:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7100) 00010000:00010000:1.0:1787829945.864164:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829945.864170:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d8300 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.864176:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d8300 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829945.990760:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829945.990913:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275734656 00000100:00100000:1.0:1787829945.990926:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275734656 00000100:00100000:1.0:1787829945.991204:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 158 00000100:00100000:1.0:1787829945.991217:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b42c89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+44:11483:x1874675275734656:12345-192.168.201.51@tcp:101:stat.0 00010000:00010000:1.0:1787829945.991248:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829945.991288:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d8307 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c89d1 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.991407:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d830e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.991438:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d830e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.991472:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d830e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.991491:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8315 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.991499:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8315 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.991506:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8315 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.991634:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d831c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.991643:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d831c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.991650:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d831c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787829945.991696:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1787829945.991701:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787829945.991730:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d831c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.991743:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d831c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.991752:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d830e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.991770:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d830e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.991776:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d830e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.991782:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feeec00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829945.991787:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d830e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.991795:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d830e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.991810:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:1.0:1787829945.991813:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829945.991819:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d830e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.991825:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d830e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.991840:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8315 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.991845:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8315 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.991850:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8315 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.991870:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feef000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829945.991879:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8315 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.991886:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8315 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.991894:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e9b507a7300) 00010000:00010000:1.0:1787829945.991896:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829945.991899:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8315 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.991904:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8315 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.991940:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d8307 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89d1 expref: 46 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.991955:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d831c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89d1 expref: 45 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829945.991963:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7100) 00010000:00010000:1.0:1787829945.991965:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787829945.991968:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feee200, rc 0) 00000100:00100000:1.0:1787829945.992102:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b42c89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+45:11483:x1874675275734656:12345-192.168.201.51@tcp:101:stat.0 Request processed in 888us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829945.992111:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 158 00010000:00010000:1.0:1787829946.018446:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787829946.058376:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829946.058579:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275734912 00000100:00100000:2.0:1787829946.058593:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275734912 00000100:00100000:2.0:1787829946.058694:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 159 00000100:00100000:2.0:1787829946.058706:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f311a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+45:11493:x1874675275734912:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:2.0:1787829946.058733:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829946.058762:0:7257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d8323 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c89d8 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787829946.059157:0:7257:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787829946.059337:0:7257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d8323 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89d8 expref: 47 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.059355:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b48f25c00) 00010000:00010000:2.0:1787829946.059359:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787829946.059364:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d8323 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89d8 expref: 47 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.059382:0:7257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3e800, rc 0) 00000100:00080000:1.0:1787829946.059672:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787829946.060251:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f311a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+46:11493:x1874675275734912:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 1542us (1884us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1787829946.060263:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 159 00000100:00100000:0.0:1787829946.074880:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829946.076227:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275735168 00000100:00100000:1.0:1787829946.076245:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275735168 00000100:00100000:1.0:1787829946.076357:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 44 00000100:00100000:1.0:1787829946.076369:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b50361050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+46:11493:x1874675275735168:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:1.0:1787829946.076980:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b50361050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+47:11493:x1874675275735168:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 611us (2126us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1787829946.076990:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 44 00000100:00100000:2.0:1787829946.141778:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829946.147260:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275735424 00000100:00100000:1.0:1787829946.147283:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275735424 00000100:00100000:1.0:1787829946.147485:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 160 00000100:00100000:1.0:1787829946.147499:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+47:11499:x1874675275735424:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:1.0:1787829946.147535:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829946.149614:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d8331 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c89df expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.149779:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8338 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.149804:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d831c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89d1 expref: 48 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.149815:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8338 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.149865:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d831c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c89d1 expref: 48 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.149887:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d831c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c89d1 expref: 48 pid: 5805 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829946.149932:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5238a940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1874675284124544:192.168.201.51@tcp:104: 00000100:00100000:1.0:1787829946.150111:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b44d20cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787829946.154721:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829946.154897:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5238a940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1874675284124544:192.168.201.51@tcp:104: 00010000:00010000:1.0:1787829946.154939:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8338 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829946.155071:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275735552 00000100:00100000:0.0:1787829946.155081:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275735552 00010000:00010000:0.0:1787829946.155130:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d831c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c89d1 expref: 49 pid: 5805 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829946.155165:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 68 00000100:00100000:0.0:1787829946.155176:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f313480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+49:2363:x1874675275735552:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787829946.155195:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829946.155204:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d831c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c89d1 expref: 49 pid: 5805 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.155219:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d831c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c89d1 expref: 49 pid: 5805 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.155251:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d831c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c89d1 expref: 49 pid: 5805 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.155274:0:8409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7100) 00010000:00010000:0.0:1787829946.155280:0:8409:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8338 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.155297:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8338 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.155319:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8338 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.155358:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787829946.155639:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8338 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.155647:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8338 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787829946.155670:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1787829946.155889:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d8331 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89df expref: 50 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.155910:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8338 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89df expref: 49 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.155919:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7100) 00010000:00010000:2.0:1787829946.155922:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787829946.155925:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feef000, rc 0) 00000100:00100000:0.0:1787829946.156070:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f313480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+49:2363:x1874675275735552:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 844us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829946.156081:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 68 00000100:00100000:2.0:1787829946.156174:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+48:11499:x1874675275735424:12345-192.168.201.51@tcp:101:bash.0 Request processed in 8678us (14411us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1787829946.156183:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 160 00000100:00100000:0.0:1787829946.159123:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829946.159320:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275735808 00000100:00100000:1.0:1787829946.159333:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275735808 00000100:00100000:1.0:1787829946.159448:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 161 00000100:00100000:1.0:1787829946.159460:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b44cc3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+48:11499:x1874675275735808:12345-192.168.201.51@tcp:36:bash.0 00010000:00010000:1.0:1787829946.159839:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d8346 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.159873:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d8346 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.159888:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d8346 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787829946.159948:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1787829946.159976:0:5805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0644ea9 reply state 00000000bad425d6 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d8346 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829946.159986:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787829946.160156:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b44cc3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+51:11499:x1874675275735808:12345-192.168.201.51@tcp:36:bash.0 Request processed in 696us (1045us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1787829946.160166:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 161 00000020:00080000:1.0:1787829946.160190:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787829946.164663:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d8346 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.164688:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d8346 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.164697:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d8346 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.164729:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feeec00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829946.164735:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d8346 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.164744:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d8346 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.164767:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7100) 00010000:00010000:2.0:1787829946.164771:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829946.164777:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d8346 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.164784:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d8346 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829946.166353:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829946.166452:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275735936 00000100:00100000:2.0:1787829946.166466:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275735936 00000100:00100000:2.0:1787829946.166554:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 162 00000100:00100000:2.0:1787829946.166567:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b44cc03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+50:11499:x1874675275735936:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:2.0:1787829946.166603:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829946.166630:0:7257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d834d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c89e6 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.166743:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d8354 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.166761:0:7257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8338 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89df expref: 51 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.166790:0:7257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d8354 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.166835:0:7257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8338 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c89df expref: 51 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.166853:0:7257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8338 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c89df expref: 51 pid: 5806 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829946.166869:0:7257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa4da40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7257:1874675284124672:192.168.201.51@tcp:104: 00000100:00100000:2.0:1787829946.166977:0:7257:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fa62d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787829946.171920:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829946.172078:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275736064 00000100:00100000:1.0:1787829946.172091:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275736064 00010000:00010000:1.0:1787829946.172164:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8338 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c89df expref: 52 pid: 5806 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829946.172207:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 69 00000100:00100000:1.0:1787829946.172219:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f310b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+52:2363:x1874675275736064:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787829946.172243:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829946.172251:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8338 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c89df expref: 52 pid: 5806 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.172267:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8338 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c89df expref: 52 pid: 5806 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.172299:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7100) 00010000:00010000:1.0:1787829946.172317:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d8354 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.172328:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d8354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.172336:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d8354 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.172360:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829946.172440:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f310b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+52:2363:x1874675275736064:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 223us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829946.172448:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 69 00010000:00010000:2.0:1787829946.173172:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d8338 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c89df expref: 51 pid: 5806 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829946.173195:0:7257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa4da40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7257:1874675284124672:192.168.201.51@tcp:104: 00010000:00010000:2.0:1787829946.173225:0:7257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d8354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.173235:0:7257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d8354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.173240:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d8354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787829946.173300:0:7257:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787829946.173316:0:7257:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787829946.173344:0:7257:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d8354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.173395:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d834d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89e6 expref: 51 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.173411:0:7257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d8354 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89e6 expref: 50 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.173432:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7100) 00010000:00010000:2.0:1787829946.173435:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787829946.173439:0:7257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3f000, rc 0) 00000100:00100000:2.0:1787829946.173492:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b44cc03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+50:11499:x1874675275735936:12345-192.168.201.51@tcp:101:bash.0 Request processed in 6929us (7152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829946.173501:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 162 00000100:00100000:3.0:1787829946.176099:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829946.177177:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275736320 00000100:00100000:2.0:1787829946.177193:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275736320 00000100:00100000:2.0:1787829946.177279:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 45 00000100:00100000:2.0:1787829946.177290:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f312d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+50:11499:x1874675275736320:12345-192.168.201.51@tcp:35:bash.0 00000100:00100000:2.0:1787829946.177892:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f312d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+51:11499:x1874675275736320:12345-192.168.201.51@tcp:35:bash.0 Request processed in 600us (1802us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1787829946.177903:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 45 00000100:00100000:0.0:1787829946.243554:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829946.243689:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275736576 00000100:00100000:3.0:1787829946.243702:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275736576 00000100:00100000:3.0:1787829946.243772:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 163 00000100:00100000:3.0:1787829946.243787:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b44cc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+51:11509:x1874675275736576:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:3.0:1787829946.243820:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829946.243858:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d835b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c89ed expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829946.244341:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787829946.244492:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d835b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89ed expref: 53 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.244510:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b48f25c00) 00010000:00010000:3.0:1787829946.244513:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787829946.244519:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d835b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89ed expref: 53 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.244534:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74899400, rc 0) 00000100:00100000:3.0:1787829946.244611:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b44cc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+52:11509:x1874675275736576:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 828us (1071us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1787829946.244620:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 163 00000100:00100000:1.0:1787829946.255108:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829946.256204:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275736704 00000100:00100000:3.0:1787829946.256222:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275736704 00000100:00100000:3.0:1787829946.256295:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 164 00000100:00100000:3.0:1787829946.256457:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5238a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+52:11509:x1874675275736704:12345-192.168.201.51@tcp:34:lfs.0 00010000:00010000:3.0:1787829946.256594:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899c00/0xc03b4d103c0d8369 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.256617:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899c00/0xc03b4d103c0d8369 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.256632:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899c00/0xc03b4d103c0d8369 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.256650:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d8370 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.256658:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d8370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.256665:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d8370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.256792:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d8377 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.256802:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d8377 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.256809:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d8377 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787829946.256864:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d8377 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.256881:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899c00/0xc03b4d103c0d8369 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.258101:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899c00/0xc03b4d103c0d8369 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.258108:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899c00/0xc03b4d103c0d8369 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.258115:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74899c00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829946.258120:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899c00/0xc03b4d103c0d8369 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.258130:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899c00/0xc03b4d103c0d8369 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.258149:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:3.0:1787829946.258152:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829946.258159:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899c00/0xc03b4d103c0d8369 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.258165:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899c00/0xc03b4d103c0d8369 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.258180:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d8370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.258186:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d8370 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.258191:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d8370 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.259076:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74898a00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829946.259097:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d8370 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.259107:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d8370 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.259122:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e9b478cce00) 00010000:00010000:3.0:1787829946.259125:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829946.259129:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d8370 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.259135:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d8370 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.259159:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d8377 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.259165:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d8377 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.259172:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d8377 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.259178:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74899000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829946.259181:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d8377 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.259186:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d8377 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.259195:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7100) 00010000:00010000:3.0:1787829946.259197:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829946.259405:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d8377 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.259412:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d8377 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829946.259541:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5238a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+52:11509:x1874675275736704:12345-192.168.201.51@tcp:34:lfs.0 Request processed in 3229us (4436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829946.259554:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 164 00000100:00100000:3.0:1787829946.262531:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829946.262592:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275736960 00000100:00100000:1.0:1787829946.262606:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275736960 00000100:00100000:1.0:1787829946.262719:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 46 00000100:00100000:1.0:1787829946.262730:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f310780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+52:11509:x1874675275736960:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:1.0:1787829946.263136:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f310780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+53:11509:x1874675275736960:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 406us (618us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1787829946.263144:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 46 00000001:00080000:3.0:1787829946.287468:0:7602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1787829946.287489:0:7602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:0.0:1787829946.304828:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829946.304937:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275737216 00000100:00100000:2.0:1787829946.304947:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275737216 00000100:00100000:2.0:1787829946.305010:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 165 00000100:00100000:2.0:1787829946.305058:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b44cc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+53:11512:x1874675275737216:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:2.0:1787829946.305084:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829946.305108:0:7257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d837e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c89f4 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.305206:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8385 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.305222:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8385 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.305232:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8385 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.305248:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d838c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.305255:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d838c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.305261:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d838c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.305399:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d8393 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.305407:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d8393 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.305414:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d8393 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787829946.305424:0:7257:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787829946.305523:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8385 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.305531:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8385 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.305545:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8385 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.305551:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f800 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829946.305555:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8385 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.305563:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8385 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.305574:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:2.0:1787829946.305577:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829946.305582:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8385 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.305589:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8385 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.305602:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d838c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.305608:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d838c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.305612:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d838c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.305616:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3ec00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829946.305619:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d838c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.305634:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d838c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.305643:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e9b455ce700) 00010000:00010000:2.0:1787829946.305645:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829946.305648:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d838c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.305654:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d838c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.305693:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d837e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89f4 expref: 56 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.305707:0:7257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d8393 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89f4 expref: 55 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.305713:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7100) 00010000:00010000:2.0:1787829946.305715:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787829946.305717:0:7257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3f600, rc 0) 00000100:00100000:2.0:1787829946.305777:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b44cc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+55:11512:x1874675275737216:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 760us (961us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1787829946.305785:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 165 00000100:00100000:1.0:1787829946.311591:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829946.311652:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829946.311726:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275737472 00000100:00100000:2.0:1787829946.311735:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275737472 00000100:00100000:2.0:1787829946.311795:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 166 00000100:00100000:2.0:1787829946.311806:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5238b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+55:11512:x1874675275737472:12345-192.168.201.51@tcp:54:lfs.0 00010000:00010000:2.0:1787829946.311902:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d83a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.311920:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d83a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.311932:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d83a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.311962:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d83a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.311970:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d83a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.311977:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d83a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.311983:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3fa00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829946.311988:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d83a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.311995:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d83a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.312007:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7100) 00010000:00010000:2.0:1787829946.312009:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787829946.312013:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d83a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.312062:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d83a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829946.312143:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5238b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+55:11512:x1874675275737472:12345-192.168.201.51@tcp:54:lfs.0 Request processed in 339us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829946.312152:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 166 00000100:00100000:3.0:1787829946.312529:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275737344 00000100:00100000:3.0:1787829946.312535:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275737344 00000100:00100000:3.0:1787829946.312579:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 12 00000100:00100000:3.0:1787829946.312586:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52389a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6abf229-545c-43fd-8dee-d9adf582be48+55:2362:x1874675275737344:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787829946.312598:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829946.312614:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d8393 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89f4 expref: 55 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.312625:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7100) 00010000:00010000:3.0:1787829946.312629:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787829946.312666:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52389a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6abf229-545c-43fd-8dee-d9adf582be48+54:2362:x1874675275737344:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 80us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829946.312672:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 12 00000100:00100000:1.0:1787829946.314493:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829946.314627:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275737728 00000100:00100000:3.0:1787829946.314640:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275737728 00000100:00100000:3.0:1787829946.314705:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 47 00000100:00100000:3.0:1787829946.314716:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+54:11512:x1874675275737728:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:2.0:1787829946.315513:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+55:11512:x1874675275737728:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 790us (1026us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1787829946.315526:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 47 00000100:00100000:2.0:1787829946.460540:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829946.460639:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275737984 00000100:00100000:3.0:1787829946.460725:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275737984 00000100:00100000:3.0:1787829946.460837:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 167 00000100:00100000:3.0:1787829946.460849:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+55:11530:x1874675275737984:12345-192.168.201.51@tcp:101:cat.0 00010000:00010000:3.0:1787829946.460886:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829946.460913:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d83a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c89fb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.461097:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d83af lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.461116:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d83af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.461130:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d83af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829946.461144:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787829946.461322:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d83a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89fb expref: 58 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.461348:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d83af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89fb expref: 57 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.461357:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7100) 00010000:00010000:3.0:1787829946.461360:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787829946.461364:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74898a00, rc 0) 00000100:00100000:3.0:1787829946.461449:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+57:11530:x1874675275737984:12345-192.168.201.51@tcp:101:cat.0 Request processed in 601us (923us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1787829946.461476:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 167 00000100:00100000:0.0:1787829946.492900:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829946.493442:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275738112 00000100:00100000:3.0:1787829946.493456:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275738112 00000100:00100000:3.0:1787829946.493592:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 168 00000100:00100000:3.0:1787829946.493604:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b44cc2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+57:11531:x1874675275738112:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:3.0:1787829946.493637:0:10044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829946.493663:0:10044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d83bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8a02 expref: -99 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.493757:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899c00/0xc03b4d103c0d83c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.493774:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899c00/0xc03b4d103c0d83c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.493787:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899c00/0xc03b4d103c0d83c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829946.493931:0:10044:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787829946.493936:0:10044:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787829946.494461:0:10044:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899c00/0xc03b4d103c0d83c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.494499:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d83bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a02 expref: 59 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.494524:0:10044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899c00/0xc03b4d103c0d83c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a02 expref: 58 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.494562:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:3.0:1787829946.494565:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787829946.494569:0:10044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74899c00, rc 0) 00000100:00100000:3.0:1787829946.494727:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b44cc2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+58:11531:x1874675275738112:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 1123us (1841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829946.494737:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 168 00000100:00100000:1.0:1787829946.500925:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829946.501504:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275738496 00000100:00100000:0.0:1787829946.501518:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275738496 00000100:00100000:0.0:1787829946.501649:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 48 00000100:00100000:0.0:1787829946.501662:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+58:11531:x1874675275738496:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:0.0:1787829946.502776:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+59:11531:x1874675275738496:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 1107us (1857us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1787829946.502789:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 48 00000100:00100000:0.0:1787829946.506604:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829946.506752:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275738624 00000100:00100000:1.0:1787829946.506766:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275738624 00000100:00100000:1.0:1787829946.507048:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 13 00000100:00100000:1.0:1787829946.507062:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b4fae5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+59:11531:x1874675275738624:12345-192.168.201.51@tcp:103:lfs.0 00010000:00010000:1.0:1787829946.507086:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787829946.507184:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f000/0xc03b4d103c0d8354 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89e6 expref: 59 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.507216:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898a00/0xc03b4d103c0d83af lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89fb expref: 58 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.507231:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d825f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c89a7 expref: 57 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.507242:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7100) 00010000:00010000:1.0:1787829946.507276:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829946.507488:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b4fae5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+56:11531:x1874675275738624:12345-192.168.201.51@tcp:103:lfs.0 Request processed in 429us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829946.507497:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 13 00000100:00100000:3.0:1787829946.510450:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829946.510766:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275738752 00000100:00100000:1.0:1787829946.510779:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275738752 00000100:00100000:1.0:1787829946.511157:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 169 00000100:00100000:1.0:1787829946.511171:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+56:11531:x1874675275738752:12345-192.168.201.51@tcp:58:lfs.0 00010000:00010000:1.0:1787829946.511327:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d83cb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.511348:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d83cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.511361:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d83cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787829946.511617:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1787829946.511732:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+56:11531:x1874675275738752:12345-192.168.201.51@tcp:58:lfs.0 Request processed in 563us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829946.511742:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 169 00000100:00100000:2.0:1787829946.529828:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829946.530435:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275738880 00000100:00100000:3.0:1787829946.530452:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275738880 00000100:00100000:3.0:1787829946.530545:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 170 00000100:00100000:3.0:1787829946.530555:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+56:11533:x1874675275738880:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:3.0:1787829946.530580:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829946.530603:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d83d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8a09 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.530689:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d83d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.530705:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d83d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.530715:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d83d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.530727:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d83e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.530731:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d83e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.530753:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d83e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.530869:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d83e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.530875:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d83e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.530880:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d83e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829946.530926:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787829946.530931:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787829946.530953:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d83e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.530965:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d83e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.530974:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d83d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.530981:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d83d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.530987:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d83d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.530994:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74899400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829946.530999:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d83d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.531014:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d83d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.531062:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:3.0:1787829946.531066:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829946.531072:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d83d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.531079:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d83d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.531096:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d83e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.531101:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d83e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.531107:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d83e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.531121:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74898200 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829946.531124:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d83e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.531130:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d83e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.531138:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e9b478cce00) 00010000:00010000:3.0:1787829946.531141:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829946.531143:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d83e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.531160:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d83e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.531194:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d83d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a09 expref: 58 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.531204:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d83e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a09 expref: 57 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.531209:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7300) 00010000:00010000:3.0:1787829946.531211:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787829946.531213:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74898000, rc 0) 00000100:00100000:3.0:1787829946.531277:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+57:11533:x1874675275738880:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 725us (1465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829946.531283:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 170 00000040:00080000:1.0:1787829946.531908:0:11648:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787829946.531916:0:11648:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787829946.532229:0:11648:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787829946.532238:0:11648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787829946.532533:0:11648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7489fc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11648:1874675284124800:192.168.201.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787829946.532756:0:11648:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b44d203c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787829946.541711:0:11648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7489fc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11648:1874675284124800:192.168.201.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787829946.542606:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829946.544554:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275739008 00000100:00100000:3.0:1787829946.544573:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275739008 00000100:00100000:3.0:1787829946.544790:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 171 00000100:00100000:3.0:1787829946.544805:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f998b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+57:11535:x1874675275739008:12345-192.168.201.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787829946.544859:0:10044:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787829946.545090:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f998b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+57:11535:x1874675275739008:12345-192.168.201.51@tcp:53:lhsmtool_posix.0 Request processed in 288us (2487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829946.545100:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 171 00000100:00100000:2.0:1787829946.550430:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829946.550503:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275739136 00000100:00100000:1.0:1787829946.550516:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275739136 00000100:00100000:1.0:1787829946.550579:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 172 00000100:00100000:1.0:1787829946.550591:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+57:11535:x1874675275739136:12345-192.168.201.51@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787829946.550696:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d83ee lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.550716:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d83ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.550845:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d83ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.550866:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d83f5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.550875:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d83f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.550882:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d83f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.550917:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d83fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.550926:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d83fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.550933:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d83fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787829946.550982:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787829946.551004:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787829946.551063:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d83fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.551077:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d83ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.551084:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d83ee lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.551092:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d83ee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.551099:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feeea00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829946.551104:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d83ee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.551122:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d83ee lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.551138:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e9b45193300) 00010000:00010000:1.0:1787829946.551141:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829946.551147:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d83ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.551153:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d83ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.551168:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d83f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.551174:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d83f5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.551191:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d83f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.551197:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feefa00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829946.551200:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d83f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.551207:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d83f5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.551215:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9e9b507a7100) 00010000:00010000:1.0:1787829946.551218:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829946.551221:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d83f5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.551226:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d83f5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.551242:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d83fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.551247:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d83fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.551252:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d83fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.551256:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feee600 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829946.551259:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d83fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.551273:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d83fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.551280:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7300) 00010000:00010000:1.0:1787829946.551282:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829946.551285:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d83fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.551311:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d83fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829946.551390:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+57:11535:x1874675275739136:12345-192.168.201.51@tcp:34:lhsmtool_posix.0 Request processed in 800us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829946.551399:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 172 00000100:00100000:0.0:1787829946.553514:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829946.553824:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275739392 00000100:00100000:3.0:1787829946.553836:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275739392 00000100:00100000:3.0:1787829946.555329:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 173 00000100:00100000:3.0:1787829946.555370:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f99ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+57:11535:x1874675275739392:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787829946.555400:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829946.555432:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d8403 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8a10 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.555573:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d840a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.555591:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d840a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.555604:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d840a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829946.555617:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787829946.556483:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d840a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.556496:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d840a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.556504:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d840a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.556511:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74898200 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829946.556517:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d840a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.556526:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d840a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.556543:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7300) 00010000:00010000:3.0:1787829946.556558:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787829946.556564:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d840a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.556572:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d840a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.556632:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d8403 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a10 expref: 59 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.556717:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e9b45193300) 00010000:00010000:3.0:1787829946.556720:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787829946.556782:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d8403 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a10 expref: 59 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.556795:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74899000, rc 0) 00000100:00100000:3.0:1787829946.557312:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f99ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+58:11535:x1874675275739392:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 1940us (3802us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787829946.557322:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 173 00000100:00100000:0.0:1787829946.560145:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829946.560260:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275739520 00000100:00100000:3.0:1787829946.560272:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275739520 00000100:00100000:3.0:1787829946.560352:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 174 00000100:00100000:3.0:1787829946.560365:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f998780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+58:11535:x1874675275739520:12345-192.168.201.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787829946.560440:0:10044:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787829946.560572:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f998780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+58:11535:x1874675275739520:12345-192.168.201.51@tcp:53:lhsmtool_posix.0 Request processed in 209us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829946.560581:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 174 00000100:00100000:2.0:1787829946.567689:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829946.567773:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275739776 00000100:00100000:1.0:1787829946.567786:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275739776 00000100:00100000:1.0:1787829946.567913:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 175 00000100:00100000:1.0:1787829946.567925:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+58:11535:x1874675275739776:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787829946.567953:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829946.567957:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787829946.567992:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899c00/0xc03b4d103c0d83c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a02 expref: 58 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.568067:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:1.0:1787829946.568075:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787829946.568093:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d8418 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8a17 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787829946.568660:0:5805:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1787829946.568888:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d841f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.568905:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d841f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.568917:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d841f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.568981:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d8418 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a17 expref: 60 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.569000:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d841f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a17 expref: 59 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.569010:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e9b507a7100) 00010000:00010000:1.0:1787829946.569014:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787829946.569054:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feefa00, rc 0) 00000100:00100000:1.0:1787829946.569138:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+59:11535:x1874675275739776:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 1215us (1460us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1787829946.569148:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 175 00000100:00100000:0.0:1787829946.585509:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829946.585869:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275740032 00000100:00100000:3.0:1787829946.586485:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275740032 00000100:00100000:2.0:1787829946.586975:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 176 00000100:00100000:2.0:1787829946.586990:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f99b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+59:11535:x1874675275740032:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787829946.587103:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829946.587139:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d841f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a17 expref: 59 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.587164:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e9b507a7100) 00010000:00010000:2.0:1787829946.587178:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787829946.587209:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d842d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.587227:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d842d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.587238:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d842d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.587270:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8434 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xcaccbfcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.587278:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8434 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xcaccbfcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.587297:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8434 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xcaccbfcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.587407:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d842d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.587416:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d842d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.587424:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d842d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.587430:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3ec00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829946.587435:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d842d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.587443:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d842d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.587452:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:2.0:1787829946.587455:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829946.587459:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d842d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.587465:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d842d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.587483:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8434 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xcaccbfcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.587489:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8434 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcaccbfcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.587494:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8434 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcaccbfcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.587500:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f800 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829946.587502:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8434 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcaccbfcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.587508:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8434 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcaccbfcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.587514:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xcaccbfcf (ffff9e9b455ce700) 00010000:00010000:2.0:1787829946.587516:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829946.587519:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8434 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xcaccbfcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.587524:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8434 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xcaccbfcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829946.587826:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f99b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+58:11535:x1874675275740032:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 Request processed in 837us (2331us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787829946.587836:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 176 00000100:00100000:0.0:1787829946.592621:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829946.592800:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275740160 00000100:00100000:3.0:1787829946.592811:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275740160 00000100:00100000:3.0:1787829946.592912:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 177 00000100:00100000:3.0:1787829946.592925:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f999e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+58:11535:x1874675275740160:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787829946.592953:0:10044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829946.592983:0:10044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d843b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8a1e expref: -99 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.593061:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d8442 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.593078:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d8442 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.593091:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d8442 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.593217:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d843b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a1e expref: 60 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.593238:0:10044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d8442 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a1e expref: 59 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.593247:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:3.0:1787829946.593250:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787829946.593254:0:10044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74898200, rc 0) 00000100:00100000:3.0:1787829946.593339:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f999e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+59:11535:x1874675275740160:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 416us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829946.593354:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 177 00000100:00100000:1.0:1787829946.599763:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829946.599863:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275740416 00000100:00100000:3.0:1787829946.599876:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275740416 00000100:00100000:3.0:1787829946.599951:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 178 00000100:00100000:3.0:1787829946.599963:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7489fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+59:11535:x1874675275740416:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787829946.600107:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d8449 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.600131:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d8449 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.600146:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d8449 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787829946.600493:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1787829946.600501:0:5805:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 326501483515ns, next at 327501481429ns, rc = 0 00000004:00010000:3.0:1787829946.600592:0:5805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003dc202b6 reply state 0000000027e4ffe5 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d8449 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829946.600600:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787829946.600711:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7489fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+61:11535:x1874675275740416:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 Request processed in 751us (964us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1787829946.600718:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 178 00000100:00100000:0.0:1787829946.606652:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00010000:00010000:3.0:1787829946.606726:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d8449 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.606742:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d8449 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.606773:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d8449 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.606781:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74899400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829946.606786:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d8449 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.606795:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d8449 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.606817:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:3.0:1787829946.606820:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787829946.606826:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d8449 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.606834:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d8449 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829946.607432:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275740544 00000100:00100000:2.0:1787829946.607447:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275740544 00000100:00100000:2.0:1787829946.607520:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 179 00000100:00100000:2.0:1787829946.607539:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f9992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+60:11535:x1874675275740544:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787829946.607568:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829946.607590:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8450 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8a25 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.607786:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8450 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a25 expref: 61 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.607803:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8450 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a25 expref: 61 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.607826:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:2.0:1787829946.607828:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787829946.607832:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3f800, rc 0) 00000100:00100000:2.0:1787829946.608358:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f9992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+61:11535:x1874675275740544:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 818us (1725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829946.608368:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 179 00000100:00100000:1.0:1787829946.614886:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829946.614982:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275740672 00000100:00100000:3.0:1787829946.614996:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275740672 00000100:00100000:3.0:1787829946.615107:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 50 00000100:00100000:3.0:1787829946.615119:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7489f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+6:2363:x1874675275740672:12345-192.168.201.51@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787829946.615570:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7489f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+7:2363:x1874675275740672:12345-192.168.201.51@tcp:2:lhsmtool_posix.0 Request processed in 454us (856us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787829946.615580:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 50 00000100:00100000:1.0:1787829946.619255:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829946.619392:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275740928 00000100:00100000:2.0:1787829946.619406:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275740928 00000100:00100000:2.0:1787829946.619483:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 49 00000100:00100000:2.0:1787829946.619495:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52389a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+61:11535:x1874675275740928:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787829946.621501:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52389a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+62:11535:x1874675275740928:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 Request processed in 1995us (2247us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1787829946.621516:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 49 00000100:00100000:0.0:1787829946.628362:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829946.628487:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275741184 00000100:00100000:3.0:1787829946.628502:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275741184 00000100:00100000:3.0:1787829946.628582:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 180 00000100:00100000:3.0:1787829946.628594:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f9983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+62:11535:x1874675275741184:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787829946.628759:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f9983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+62:11535:x1874675275741184:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 Request processed in 167us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829946.628768:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 180 00000100:00100000:1.0:1787829946.633447:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829946.633557:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275741312 00000100:00100000:2.0:1787829946.633569:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275741312 00000100:00100000:2.0:1787829946.633666:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 181 00000100:00100000:2.0:1787829946.633679:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+62:11535:x1874675275741312:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787829946.633707:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829946.633749:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d8457 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8a2c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.633973:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d845e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.633992:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d845e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.634006:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d845e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787829946.634098:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787829946.634121:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d845e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.634153:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d8457 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a2c expref: 64 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.634173:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d845e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a2c expref: 63 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.634182:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:2.0:1787829946.634185:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787829946.634189:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3ec00, rc 0) 00000100:00100000:2.0:1787829946.634264:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+63:11535:x1874675275741312:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 588us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829946.634280:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 181 00000100:00100000:2.0:1787829946.636412:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829946.636475:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275741440 00000100:00100000:0.0:1787829946.636485:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275741440 00000100:00100000:0.0:1787829946.636536:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 51 00000100:00100000:0.0:1787829946.636543:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+7:2362:x1874675275741440:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787829946.636560:0:6651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829946.636579:0:6651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7d3aa80/0xc03b4d103c0d8465 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8a33 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787829946.636606:0:6651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a901ebb, blocks: 0x1 00010000:00010000:0.0:1787829946.636627:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=326s v=(0 0) 00010000:00010000:0.0:1787829946.636630:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787829946.636639:0:6651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d3aa80/0xc03b4d103c0d8465 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a33 expref: 8 pid: 6651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.636663:0:6651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f7d3aa80/0xc03b4d103c0d8465 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a33 expref: 8 pid: 6651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.636679:0:6651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7fa7e200, rc 0) 00000100:00100000:0.0:1787829946.636756:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+8:2362:x1874675275741440:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 212us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829946.636764:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 51 00000100:00100000:1.0:1787829946.638993:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829946.639161:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275741696 00000100:00100000:2.0:1787829946.639173:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275741696 00000100:00100000:2.0:1787829946.639240:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 182 00000100:00100000:2.0:1787829946.639251:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+63:11535:x1874675275741696:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787829946.639391:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+63:11535:x1874675275741696:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 Request processed in 142us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829946.639400:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 182 00000100:00100000:2.0:1787829946.641399:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829946.641453:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275741824 00000100:00100000:3.0:1787829946.641464:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275741824 00000100:00100000:3.0:1787829946.641514:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 52 00000100:00100000:3.0:1787829946.641521:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+8:11535:x1874675275741824:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787829946.641541:0:6650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829946.641560:0:6650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffbb4870/0xc03b4d103c0d846c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8a3a expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.641593:0:6650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7d3aa80/0xc03b4d103c0d8465 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a33 expref: 9 pid: 6651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.641600:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787829946.641604:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787829946.641608:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffbb4870/0xc03b4d103c0d846c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a3a expref: 9 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.641640:0:6650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f7d3aa80/0xc03b4d103c0d8465 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a33 expref: 9 pid: 6651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.641653:0:6650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f7d3aa80/0xc03b4d103c0d8465 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a33 expref: 9 pid: 6651 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829946.641665:0:6650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f311e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6650:1874675284124928:192.168.201.51@tcp:104: 00000100:00100000:3.0:1787829946.641785:0:6650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b7293c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787829946.643333:0:6650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f311e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6650:1874675284124928:192.168.201.51@tcp:104: 00010000:00010000:3.0:1787829946.643381:0:6650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ffbb4870/0xc03b4d103c0d846c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a3a expref: 9 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.643409:0:6650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74899400, rc 0) 00000100:00100000:3.0:1787829946.643474:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+9:11535:x1874675275741824:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 1951us (2086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829946.643485:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 52 00000100:00100000:1.0:1787829946.644964:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829946.645128:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275741952 00000100:00100000:3.0:1787829946.645149:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275741952 00010000:00010000:3.0:1787829946.645194:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d3aa80/0xc03b4d103c0d8465 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a33 expref: 9 pid: 6651 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829946.645237:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 70 00000100:00100000:3.0:1787829946.645248:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6abf229-545c-43fd-8dee-d9adf582be48+9:2363:x1874675275741952:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787829946.645264:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829946.645289:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f7d3aa80/0xc03b4d103c0d8465 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a33 expref: 9 pid: 6651 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.645331:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f7d3aa80/0xc03b4d103c0d8465 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a33 expref: 9 pid: 6651 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.645363:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7d3aa80/0xc03b4d103c0d8465 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a33 expref: 9 pid: 6651 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.645407:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787829946.645410:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787829946.645418:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffbb4870/0xc03b4d103c0d846c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a3a expref: 8 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.645428:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffbb4870/0xc03b4d103c0d846c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a3a expref: 8 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.645463:0:5791:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ffbb4870/0xc03b4d103c0d846c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a3a expref: 8 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829946.645473:0:5791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f311e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5791:1874675284125056:192.168.201.51@tcp:105: 00000100:00100000:3.0:1787829946.645559:0:5791:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b7293c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787829946.648222:0:5791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f311e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5791:1874675284125056:192.168.201.51@tcp:105: 00010000:00010000:3.0:1787829946.648264:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829946.648503:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6abf229-545c-43fd-8dee-d9adf582be48+8:2363:x1874675275741952:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 3254us (3545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829946.648540:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 70 00000100:00100000:1.0:1787829946.651975:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829946.652096:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275742080 00000100:00100000:3.0:1787829946.652110:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275742080 00002000:00100000:3.0:1787829946.652180:0:6655:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9e9b7fe6ed00 x1874675275742080/t0(0) o4->b6abf229-545c-43fd-8dee-d9adf582be48@192.168.201.51@tcp:527/0 lens 504/0 e 0 to 0 dl 1787829957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787829946.652193:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e9b7fe6ed00 with x1874675275742080 ext(0->8) 00002000:00010000:3.0:1787829946.652201:0:6655:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e9b7fe6ed00 00000100:00100000:3.0:1787829946.652239:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 4 00000100:00100000:3.0:1787829946.652251:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b6abf229-545c-43fd-8dee-d9adf582be48+8:2363:x1874675275742080:12345-192.168.201.51@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787829946.653114:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b6abf229-545c-43fd-8dee-d9adf582be48+10:2363:x1874675275742080:12345-192.168.201.51@tcp:4:lhsmtool_posix.0 Request processed in 860us (1150us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787829946.653127:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 4 00002000:00100000:3.0:1787829946.653136:0:6655:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9e9b7fe6ed00 x1874675275742080/t4294967314(0) o4->b6abf229-545c-43fd-8dee-d9adf582be48@192.168.201.51@tcp:527/0 lens 504/448 e 0 to 0 dl 1787829957 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787829946.653146:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e9b7fe6ed00 with x1874675275742080 ext(0->8) 00002000:00010000:3.0:1787829946.653150:0:6655:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e9b7fe6ed00 00000100:00100000:1.0:1787829946.657881:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829946.658184:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275742208 00000100:00100000:3.0:1787829946.658199:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275742208 00000100:00100000:3.0:1787829946.658280:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 183 00000100:00100000:3.0:1787829946.658293:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+63:11535:x1874675275742208:12345-192.168.201.51@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787829946.692457:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000004:00080000:0.0:1787829946.692483:0:5827:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787829946.692500:0:5827:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e9b47e280c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1787829946.692506:0:5827:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e9b51a4b600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e9b47e28a80 00000020:00080000:0.0:1787829946.692509:0:5827:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e9b51a4b200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e9b44d33c00 00000100:00100000:2.0:1787829946.692725:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284125184:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787829946.692808:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787829946.693114:0:5838:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1787829946.693337:0:5838:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:1.0:1787829946.693385:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000001:00080000:1.0:1787829946.693417:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1787829946.693444:0:5827:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:3.0:1787829946.693572:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787829946.693581:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f311e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284125312:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787829946.693616:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829946.693858:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+18:11535:x1874675275742208:12345-192.168.201.51@tcp:44:lhsmtool_posix.0 Request processed in 35565us (35988us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829946.693872:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 183 00000100:00100000:0.0:1787829946.694085:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284125184 00000100:00100000:0.0:1787829946.694095:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284125184 00000100:00100000:0.0:1787829946.694153:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284125312 00000100:00100000:0.0:1787829946.694157:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284125312 00000100:00100000:0.0:1787829946.694196:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787829946.694206:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284125184:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787829946.694238:0:6651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:0.0:1787829946.694281:0:6651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a901eb9, atime: 0x6a901eb9, ctime: 0x6a901eb9, blocks: 0xb 00010000:00010000:0.0:1787829946.694292:0:6651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd214991/0xc03b4d103c0d8473 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.694323:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=326s v=(0 0) 00010000:00010000:0.0:1787829946.694328:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787829946.694337:0:6651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd214991/0xc03b4d103c0d8473 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.694356:0:6651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd214991/0xc03b4d103c0d8473 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.694367:0:6651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd214991/0xc03b4d103c0d8473 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.694395:0:6651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd214991/0xc03b4d103c0d8473 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.694415:0:6651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787829946.695077:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3280:x1874675284125184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 870us (2266us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787829946.695086:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787829946.695112:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787829946.695121:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284125312:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787829946.695243:0:6651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787829946.695246:0:6651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787829947 00002000:00010000:0.0:1787829946.695248:0:6651:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787829946.695249:0:6651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787829947 -> 1787829947 00002000:00010000:0.0:1787829946.695251:0:6651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787829946.695271:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3280:x1874675284125312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 154us (1655us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787829946.695275:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1787829946.695477:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787829946.695487:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787829946.695495:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd214991/0xc03b4d103c0d8473 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.695504:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7f000 already unused, calling callback (ffffffffc1651420) 00010000:00010000:1.0:1787829946.695509:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd214991/0xc03b4d103c0d8473 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.695517:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd214991/0xc03b4d103c0d8473 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.695535:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd214991/0xc03b4d103c0d8473 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.695539:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd214991/0xc03b4d103c0d8473 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.695556:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829946.695557:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829946.695558:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787829946.695800:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e9b7f311e00/2, rc 0, transno 4294967315 00000100:00100000:3.0:1787829946.695807:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f311e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284125312:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787829946.695817:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1787829946.695822:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1787829946.695899:0:3280:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9e9b7f998000 x1874675284125184/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787829962 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787829946.695907:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e9b7f998000/2, rc 0, transno 4294967307 00000100:00100000:3.0:1787829946.695911:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284125184:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787829946.700869:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829946.700976:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275742336 00000100:00100000:0.0:1787829946.700990:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275742336 00000100:00100000:0.0:1787829946.701107:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 55 00000100:00100000:0.0:1787829946.701119:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+10:2363:x1874675275742336:12345-192.168.201.51@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787829946.753731:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:1.0:1787829946.753778:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:0.0:1787829946.754549:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+7:2363:x1874675275742336:12345-192.168.201.51@tcp:16:lhsmtool_posix.0 Request processed in 53422us (53685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829946.754573:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 55 00000100:00100000:1.0:1787829946.764442:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829946.765206:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275742592 00000100:00100000:3.0:1787829946.765222:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275742592 00000100:00100000:3.0:1787829946.767890:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 184 00000100:00100000:3.0:1787829946.767919:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+18:11535:x1874675275742592:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787829946.768001:0:7257:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829946.768062:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d845e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a2c expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.768088:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:3.0:1787829946.768094:0:7257:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787829946.768133:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d847a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.768150:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d847a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.768161:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d847a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787829946.768518:0:7257:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a956f256 reply state 00000000d9d44679 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d847a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829946.768530:0:7257:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787829946.768682:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+19:11535:x1874675275742592:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 Request processed in 773us (4255us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787829946.768691:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 184 00010000:00010000:2.0:1787829946.771690:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d847a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.771715:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d847a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.771723:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d847a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.771730:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74899000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829946.771738:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d847a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.771765:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d847a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.771785:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:2.0:1787829946.771788:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829946.771794:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d847a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.771801:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d847a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829946.780648:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829946.780752:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275742720 00000100:00100000:3.0:1787829946.780765:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275742720 00000100:00100000:3.0:1787829946.780841:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 56 00000100:00100000:3.0:1787829946.780870:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+7:2362:x1874675275742720:12345-192.168.201.51@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787829946.781282:0:6650:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787829946.781287:0:6650:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787829947 -> 1787829946 00002000:00010000:3.0:1787829946.781290:0:6650:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787829945 00002000:00010000:3.0:1787829946.781292:0:6650:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787829947 -> 1787829946 00002000:00010000:3.0:1787829946.781294:0:6650:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787829946.781386:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+8:2362:x1874675275742720:12345-192.168.201.51@tcp:2:lhsmtool_posix.0 Request processed in 517us (752us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787829946.781395:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 56 00000100:00100000:1.0:1787829946.785889:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829946.786495:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275742976 00000100:00100000:3.0:1787829946.786510:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275742976 00000100:00100000:3.0:1787829946.786592:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 185 00000100:00100000:3.0:1787829946.786603:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52387c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+18:11535:x1874675275742976:12345-192.168.201.51@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787829946.786702:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d8481 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.786724:0:10044:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d8442 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a1e expref: 18 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.786736:0:10044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d8481 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.786782:0:10044:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d8442 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a1e expref: 18 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.786797:0:10044:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d8442 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a1e expref: 18 pid: 10044 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829946.786849:0:10044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3103c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10044:1874675284125440:192.168.201.51@tcp:104: 00000100:00100000:3.0:1787829946.786986:0:10044:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b7293c480 going to sleep for 11 seconds 00000100:00100000:1.0:1787829946.790144:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829946.790591:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275743104 00000100:00100000:0.0:1787829946.790606:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275743104 00010000:00010000:0.0:1787829946.790665:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d8442 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a1e expref: 19 pid: 10044 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829946.790719:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 71 00000100:00100000:0.0:1787829946.790731:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+19:2362:x1874675275743104:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787829946.790754:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829946.790763:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d8442 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a1e expref: 19 pid: 10044 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.790780:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d8442 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a1e expref: 19 pid: 10044 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.790810:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:0.0:1787829946.790817:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d8481 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.790845:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d8481 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.790855:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d8481 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.790881:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829946.790979:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+19:2362:x1874675275743104:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 249us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829946.790988:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 71 00010000:00010000:2.0:1787829946.792604:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898200/0xc03b4d103c0d8442 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a1e expref: 18 pid: 10044 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829946.792635:0:10044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3103c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10044:1874675284125440:192.168.201.51@tcp:104: 00010000:00010000:2.0:1787829946.792666:0:10044:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d8481 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.792677:0:10044:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d8481 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.792682:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d8481 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.792719:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d8481 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.792726:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d8481 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.792763:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d8481 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.792769:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74899600 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829946.792774:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d8481 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.792782:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d8481 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.792801:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:2.0:1787829946.792804:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787829946.792810:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d8481 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.792817:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d8481 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829946.793682:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52387c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+17:11535:x1874675275742976:12345-192.168.201.51@tcp:55:lhsmtool_posix.0 Request processed in 7072us (7801us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787829946.793695:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 185 00000100:00100000:1.0:1787829946.804376:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829946.804691:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275743232 00000100:00100000:0.0:1787829946.804722:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275743232 00000100:00100000:0.0:1787829946.804804:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 57 00000100:00100000:0.0:1787829946.804816:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+8:2363:x1874675275743232:12345-192.168.201.51@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787829946.804896:0:8603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bf307cbb/0xc03b4d103c0d8488 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.804923:0:8603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffbb4870/0xc03b4d103c0d846c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a3a expref: 8 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.804933:0:8603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787829946.804938:0:8603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787829946.804943:0:8603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf307cbb/0xc03b4d103c0d8488 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.805212:0:8603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ffbb4870/0xc03b4d103c0d846c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a3a expref: 8 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.805230:0:8603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ffbb4870/0xc03b4d103c0d846c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a3a expref: 8 pid: 6650 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829946.805249:0:8603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f998f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8603:1874675284125568:192.168.201.51@tcp:104: 00000100:00100000:0.0:1787829946.805697:0:8603:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4548e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787829946.812582:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829946.812791:0:8603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f998f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8603:1874675284125568:192.168.201.51@tcp:104: 00010000:00010000:0.0:1787829946.812840:0:8603:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bf307cbb/0xc03b4d103c0d8488 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829946.813438:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275743360 00000100:00100000:1.0:1787829946.813450:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275743360 00010000:00010000:1.0:1787829946.813503:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ffbb4870/0xc03b4d103c0d846c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a3a expref: 9 pid: 6650 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829946.813589:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 72 00000100:00100000:1.0:1787829946.813602:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f310000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+9:2363:x1874675275743360:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787829946.813624:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829946.813655:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ffbb4870/0xc03b4d103c0d846c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a3a expref: 9 pid: 6650 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.813671:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ffbb4870/0xc03b4d103c0d846c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a3a expref: 9 pid: 6650 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.813715:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffbb4870/0xc03b4d103c0d846c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a3a expref: 9 pid: 6650 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.813737:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787829946.813742:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787829946.813748:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf307cbb/0xc03b4d103c0d8488 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.813778:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf307cbb/0xc03b4d103c0d8488 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.813818:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829946.813903:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f310000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+8:2363:x1874675275743360:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 302us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829946.813911:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 72 00010000:00010000:3.0:1787829946.814584:0:8603:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bf307cbb/0xc03b4d103c0d8488 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.814601:0:8603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf307cbb/0xc03b4d103c0d8488 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.814639:0:8603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bf307cbb/0xc03b4d103c0d8488 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.814648:0:8603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf307cbb/0xc03b4d103c0d8488 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.814656:0:8603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf307cbb/0xc03b4d103c0d8488 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.814663:0:8603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7e000 already unused, calling callback (ffffffffc1651420) 00010000:00010000:3.0:1787829946.814668:0:8603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf307cbb/0xc03b4d103c0d8488 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.814678:0:8603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf307cbb/0xc03b4d103c0d8488 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.814713:0:8603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf307cbb/0xc03b4d103c0d8488 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.814722:0:8603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf307cbb/0xc03b4d103c0d8488 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829946.814811:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+7:2363:x1874675275743232:12345-192.168.201.51@tcp:1:lhsmtool_posix.0 Request processed in 9994us (10447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829946.814822:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 57 00000100:00100000:3.0:1787829946.817403:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829946.817575:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275743616 00000100:00100000:2.0:1787829946.817588:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275743616 00000100:00100000:2.0:1787829946.817666:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 186 00000100:00100000:2.0:1787829946.817677:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f310f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+17:11535:x1874675275743616:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787829946.817782:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d848f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.817805:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d848f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.817849:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d848f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.818436:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d8496 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.818451:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8450 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a25 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.818461:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d8496 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.818504:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8450 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a25 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.818521:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8450 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a25 expref: 18 pid: 5804 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829946.818539:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b47a7a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1874675284125696:192.168.201.51@tcp:104: 00000100:00100000:2.0:1787829946.818695:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fa623c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787829946.830673:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b47a7a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1874675284125696:192.168.201.51@tcp:104: 00010000:00010000:1.0:1787829946.830717:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d8496 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829946.832728:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829946.833066:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275743744 00000100:00100000:1.0:1787829946.833077:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275743744 00010000:00010000:1.0:1787829946.833130:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8450 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a25 expref: 19 pid: 5804 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829946.833173:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 73 00000100:00100000:1.0:1787829946.833183:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f311680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+19:2362:x1874675275743744:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787829946.833203:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829946.833211:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8450 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a25 expref: 19 pid: 5804 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.833227:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8450 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a25 expref: 19 pid: 5804 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.833255:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d8450 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a25 expref: 19 pid: 5804 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.834715:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:1.0:1787829946.834728:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d8496 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.834742:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d8496 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.834752:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d8496 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829946.834789:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829946.834875:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f311680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+18:2362:x1874675275743744:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 1688us (2156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829946.834893:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 73 00010000:00010000:2.0:1787829946.835069:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d8496 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.835078:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d8496 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787829946.835679:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1787829946.835871:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1787829946.835922:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1787829946.836118:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b47a7bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5805:1874675284125824:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787829946.836196:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829946.836238:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fa62e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787829946.836923:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284125824 00000100:00100000:1.0:1787829946.836935:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284125824 00000100:00100000:1.0:1787829946.836994:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787829946.837004:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b47a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5805:x1874675284125824:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787829946.837151:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b47a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5805:x1874675284125824:12345-0@lo:1000:mdt00_001.0 Request processed in 148us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829946.837159:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787829946.838745:0:5805:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1787829946.838759:0:5805:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e9b7f311e00, transno 4294967315 00000100:00100000:2.0:1787829946.838777:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b47a7bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5805:1874675284125824:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787829946.843814:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1787829946.843996:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b47a7bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5805:1874675284125952:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787829946.844118:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829946.844180:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fa62780 going to sleep for 11 seconds 00000100:00100000:3.0:1787829946.845825:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284125952 00000100:00100000:3.0:1787829946.845849:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284125952 00000100:00100000:3.0:1787829946.845934:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787829946.845947:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f5461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5805:x1874675284125952:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787829946.846648:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f5461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5805:x1874675284125952:12345-0@lo:1000:mdt00_001.0 Request processed in 700us (2526us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1787829946.846659:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787829946.846926:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b47a7bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5805:1874675284125952:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787829946.847084:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d8496 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.847097:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d8496 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.847107:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d8496 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.847114:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3e800 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829946.847120:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d8496 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.847130:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d8496 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.847152:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:2.0:1787829946.847156:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787829946.847560:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d8496 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.847570:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d8496 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.847611:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d83cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.847618:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d83cb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.847624:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d83cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.847629:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feee000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829946.847632:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d83cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.847639:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d83cb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.847649:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7300) 00010000:00010000:2.0:1787829946.847652:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787829946.847655:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d83cb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.847660:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d83cb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.847684:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d849d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.847703:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d83e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a09 expref: 21 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.847721:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d849d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.847768:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d83e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a09 expref: 21 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.847783:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d83e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a09 expref: 21 pid: 5804 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829946.847799:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f545a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1874675284126080:192.168.201.51@tcp:104: 00000100:00100000:2.0:1787829946.849532:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fa62780 going to sleep for 11 seconds 00000100:00100000:3.0:1787829946.853169:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f545a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1874675284126080:192.168.201.51@tcp:104: 00010000:00010000:3.0:1787829946.853214:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d849d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829946.863625:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829946.863729:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275743872 00000100:00100000:0.0:1787829946.863742:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275743872 00010000:00010000:0.0:1787829946.863798:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d83e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a09 expref: 22 pid: 5804 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829946.863860:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 74 00000100:00100000:0.0:1787829946.863872:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f311e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6abf229-545c-43fd-8dee-d9adf582be48+22:2361:x1874675275743872:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787829946.863900:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829946.863909:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d83e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a09 expref: 22 pid: 5804 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.863927:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d83e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a09 expref: 22 pid: 5804 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.864414:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d83e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a09 expref: 22 pid: 5804 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.864440:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7300) 00010000:00010000:0.0:1787829946.864447:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d849d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.864459:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d849d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.864468:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d849d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829946.864523:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829946.864601:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f311e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6abf229-545c-43fd-8dee-d9adf582be48+21:2361:x1874675275743872:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 730us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829946.864610:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 74 00010000:00010000:3.0:1787829946.865619:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d849d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.865652:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d849d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.865668:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d849d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.865674:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d849d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.865682:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d849d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.865687:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3ea00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829946.865692:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d849d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.865700:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d849d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.865719:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7300) 00010000:00010000:3.0:1787829946.865722:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829946.865728:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d849d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.865736:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ea00/0xc03b4d103c0d849d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.865752:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d848f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.865759:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d848f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.865771:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d848f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.865777:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3ee00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829946.865780:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d848f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.865786:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d848f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.865794:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7300) 00010000:00010000:3.0:1787829946.865797:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787829946.865800:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d848f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.865807:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d848f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787829946.866474:0:11648:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787829946.866482:0:11648:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787829946.867131:0:11648:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1787829946.867144:0:11648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787829946.867579:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f310f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+20:11535:x1874675275743616:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 Request processed in 49894us (50195us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1787829946.867593:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 186 00000020:00080000:3.0:1787829946.867600:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787829946.892414:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829946.893268:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275744128 00000100:00100000:2.0:1787829946.893283:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275744128 00000100:00100000:2.0:1787829946.893440:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 50 00000100:00100000:2.0:1787829946.893453:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b50361c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+20:11535:x1874675275744128:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787829946.895781:0:5808:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787829946.897145:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1787829946.897327:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d84a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.897351:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d84a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.897378:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d84a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.897389:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d84a4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.897397:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d84a4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.897404:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d84a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829946.897427:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787829946.897571:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b50361c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+22:11535:x1874675275744128:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 Request processed in 4113us (5166us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1787829946.897584:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 50 00000020:00080000:2.0:1787829946.897592:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787829946.905337:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787829946.905361:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d84a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.905377:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3e800 already unused, calling callback (ffffffffc1651420) 00010000:00010000:3.0:1787829946.905382:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d84a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.905427:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d84a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.905453:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e9b455ce700) 00010000:00010000:3.0:1787829946.905457:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787829946.905463:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d84a4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.905469:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d84a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829946.905503:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829946.905505:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829946.905507:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829947.042684:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787829947.664290:0:12471:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787829947.664304:0:12471:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787829947.664351:0:12471:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787829947.664357:0:12471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787829947.821092:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829947.821233:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275744384 00000100:00100000:1.0:1787829947.821247:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275744384 00000100:00100000:1.0:1787829947.821335:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 187 00000100:00100000:1.0:1787829947.821347:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f998f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+22:11554:x1874675275744384:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:1.0:1787829947.821385:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829947.821416:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d84ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8a41 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.821895:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d84b2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.821916:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d84b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.821934:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d84b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787829947.821949:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1787829947.822231:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeec00/0xc03b4d103c0d84ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a41 expref: 25 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.822252:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d84b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a41 expref: 24 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.822261:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:1.0:1787829947.822264:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787829947.822267:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feee000, rc 0) 00000100:00100000:1.0:1787829947.822368:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f998f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+24:11554:x1874675275744384:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 1023us (1290us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1787829947.822388:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 187 00000100:00100000:0.0:1787829947.831306:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829947.834659:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275744512 00000100:00100000:1.0:1787829947.834679:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275744512 00000100:00100000:1.0:1787829947.834771:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 188 00000100:00100000:1.0:1787829947.835066:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f999680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+24:11554:x1874675275744512:12345-192.168.201.51@tcp:34:lfs.0 00010000:00010000:1.0:1787829947.835182:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d84c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.835204:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d84c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.835219:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d84c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.835236:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d84c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.835245:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d84c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.835252:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d84c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.837339:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d84ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.837365:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d84ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.837380:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d84ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787829947.837458:0:10044:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d84ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.837476:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d84c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.837483:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d84c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.837490:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d84c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.837498:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feee800 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829947.837503:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d84c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.837512:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d84c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.837950:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:1.0:1787829947.837957:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829947.837965:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d84c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.837973:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d84c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.837991:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d84c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.837998:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d84c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.838011:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d84c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.838233:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feef400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829947.838237:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d84c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.838244:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d84c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.838255:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e9b507a7200) 00010000:00010000:1.0:1787829947.838258:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829947.838262:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d84c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.838268:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d84c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.838300:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d84ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.838307:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d84ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.838313:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d84ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.838318:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feee600 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829947.838321:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d84ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.838339:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d84ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.838348:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7e00) 00010000:00010000:1.0:1787829947.838350:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829947.838354:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d84ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.838360:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d84ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829947.838500:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f999680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+24:11554:x1874675275744512:12345-192.168.201.51@tcp:34:lfs.0 Request processed in 3712us (7200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829947.838514:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 188 00000100:00100000:1.0:1787829947.899981:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829947.900307:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275744768 00000100:00100000:3.0:1787829947.900322:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275744768 00000100:00100000:3.0:1787829947.900397:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 189 00000100:00100000:3.0:1787829947.900409:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+24:11557:x1874675275744768:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:3.0:1787829947.900436:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829947.900468:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d84d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8a48 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.901335:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d84dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.901360:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d84dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.901375:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d84dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.901407:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d84e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.901416:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d84e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.901424:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d84e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.904921:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d84ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.904952:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d84ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.904966:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d84ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829947.904988:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787829947.905394:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d84dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.905403:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d84dc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.905411:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d84dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.905419:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74898400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829947.905425:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d84dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.905447:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d84dc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.905464:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:3.0:1787829947.905484:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829947.905491:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d84dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.905497:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d84dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.905514:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d84e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.905520:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d84e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.905526:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d84e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.905542:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74898e00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829947.905545:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d84e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.905551:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d84e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.905559:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e9b478cc300) 00010000:00010000:3.0:1787829947.905562:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829947.905565:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d84e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.905581:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d84e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.905655:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d84d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a48 expref: 27 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.905674:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d84ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a48 expref: 26 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.905683:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b478cc900) 00010000:00010000:3.0:1787829947.905685:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787829947.905688:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74899800, rc 0) 00000100:00100000:3.0:1787829947.905785:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+26:11557:x1874675275744768:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 5377us (5818us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1787829947.905797:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 189 00000100:00100000:2.0:1787829947.919766:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829947.919825:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275744896 00000100:00100000:2.0:1787829947.919839:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275744896 00000100:00100000:2.0:1787829947.919907:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 190 00000100:00100000:2.0:1787829947.919919:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f545a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+26:11557:x1874675275744896:12345-192.168.201.51@tcp:54:lfs.0 00010000:00010000:2.0:1787829947.920013:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d84f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829947.920059:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d84f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829947.920073:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d84f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829947.920121:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d84f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829947.920129:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d84f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829947.920137:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d84f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829947.920156:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3fa00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829947.920161:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d84f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829947.920171:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d84f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829947.920190:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b478cc900) 00010000:00010000:2.0:1787829947.920193:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787829947.920200:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d84f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829947.920207:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d84f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829947.920303:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f545a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+26:11557:x1874675275744896:12345-192.168.201.51@tcp:54:lfs.0 Request processed in 385us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829947.920312:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 190 00000100:00100000:2.0:1787829947.925366:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829947.925426:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275745152 00000100:00100000:2.0:1787829947.925438:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275745152 00000100:00100000:2.0:1787829947.925512:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 51 00000100:00100000:2.0:1787829947.925522:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+26:11557:x1874675275745152:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:2.0:1787829947.926939:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+27:11557:x1874675275745152:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 1412us (1584us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1787829947.926953:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 51 00000100:00100000:0.0:1787829947.982312:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829947.982451:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275745408 00000100:00100000:1.0:1787829947.982465:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275745408 00000100:00100000:1.0:1787829947.984544:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 191 00000100:00100000:1.0:1787829947.984577:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f99a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+27:11091:x1874675275745408:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:1.0:1787829947.984615:0:10044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829947.984650:0:10044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d84ff lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8a4f expref: -99 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.984815:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d8506 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.984833:0:10044:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d84ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a48 expref: 28 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.984863:0:10044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d8506 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.984991:0:10044:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d84ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a48 expref: 28 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829947.985008:0:10044:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d84ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a48 expref: 28 pid: 5805 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829947.985050:0:10044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3cc780 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10044:1874675284126208:192.168.201.51@tcp:104: 00000100:00100000:1.0:1787829947.985717:0:10044:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b75ca4540 going to sleep for 11 seconds 00000100:00100000:1.0:1787829947.989678:0:10044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3cc780 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10044:1874675284126208:192.168.201.51@tcp:104: 00010000:00010000:1.0:1787829947.989719:0:10044:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d8506 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829947.990201:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829947.990293:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275745536 00000100:00100000:2.0:1787829947.990303:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275745536 00010000:00010000:2.0:1787829947.990355:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d84ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a48 expref: 29 pid: 5805 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829947.990397:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 75 00000100:00100000:2.0:1787829947.990405:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f99b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+29:2363:x1874675275745536:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787829947.990421:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829947.990427:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d84ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a48 expref: 29 pid: 5805 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829947.990438:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d84ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a48 expref: 29 pid: 5805 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829947.990461:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d84ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a48 expref: 29 pid: 5805 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829947.990477:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b478cc900) 00010000:00010000:2.0:1787829947.990481:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d8506 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829947.990489:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d8506 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829947.990511:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d8506 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829947.990545:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787829947.990604:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f99b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+28:2363:x1874675275745536:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 200us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829947.990610:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 75 00010000:00010000:3.0:1787829947.990758:0:10044:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d8506 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.990767:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d8506 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829947.990792:0:10044:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787829947.991000:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d84ff lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a4f expref: 29 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.991069:0:10044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d8506 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a4f expref: 28 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.991087:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b478cc900) 00010000:00010000:3.0:1787829947.991090:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787829947.991093:0:10044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feef400, rc 0) 00000100:00100000:3.0:1787829947.991130:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f99a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+28:11091:x1874675275745408:12345-192.168.201.51@tcp:101:bash.0 Request processed in 6572us (8834us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1787829947.991137:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 191 00000100:00100000:2.0:1787829947.994696:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829947.994790:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275745792 00000100:00100000:3.0:1787829947.994804:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275745792 00000100:00100000:3.0:1787829947.994879:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 192 00000100:00100000:3.0:1787829947.994891:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+28:11091:x1874675275745792:12345-192.168.201.51@tcp:36:bash.0 00010000:00010000:3.0:1787829947.995555:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8514 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.995580:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8514 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829947.995594:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8514 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787829947.995657:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1787829947.995683:0:5805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d5a1f50 reply state 00000000d163d5ac transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8514 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829947.995693:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787829947.995740:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1787829947.996401:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+32:11091:x1874675275745792:12345-192.168.201.51@tcp:36:bash.0 Request processed in 1505us (1713us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1787829947.996412:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 192 00000020:00080000:3.0:1787829947.996439:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787829948.001528:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8514 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829948.001600:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00010000:00010000:3.0:1787829948.001622:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8514 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.001631:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8514 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.001638:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74899a00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829948.001644:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8514 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.001653:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8514 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.001675:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b478cc900) 00010000:00010000:3.0:1787829948.001679:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829948.001686:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8514 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.001693:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8514 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829948.003311:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275745920 00000100:00100000:2.0:1787829948.003331:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275745920 00000100:00080000:3.0:1787829948.003395:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787829948.003522:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 193 00000100:00100000:2.0:1787829948.003548:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f99bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+31:11091:x1874675275745920:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:2.0:1787829948.003579:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829948.003607:0:7257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d851b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8a56 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.003700:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d851b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a56 expref: 32 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.003717:0:7257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d851b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a56 expref: 32 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.003742:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b478cc900) 00010000:00010000:2.0:1787829948.003746:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787829948.003762:0:7257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3fa00, rc 0) 00000100:00100000:2.0:1787829948.003855:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f99bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+32:11091:x1874675275745920:12345-192.168.201.51@tcp:101:bash.0 Request processed in 311us (2259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829948.004357:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 193 00000100:00100000:0.0:1787829948.011443:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829948.011722:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275746048 00000100:00100000:3.0:1787829948.011735:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275746048 00000100:00100000:2.0:1787829948.012185:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 58 00000100:00100000:2.0:1787829948.012196:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f99a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+7:11091:x1874675275746048:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:2.0:1787829948.012219:0:6650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829948.012242:0:6650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aee9f3b5/0xc03b4d103c0d8522 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8a5d expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787829948.012272:0:6650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a901eba, atime: 0x6a901eb9, ctime: 0x6a901eba, blocks: 0xb 00010000:00010000:2.0:1787829948.012316:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=327s v=(0 0) 00010000:00010000:2.0:1787829948.012322:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787829948.012332:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aee9f3b5/0xc03b4d103c0d8522 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a5d expref: 8 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.012357:0:6650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aee9f3b5/0xc03b4d103c0d8522 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a5d expref: 8 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787829948.012360:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787829948.012374:0:6650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3f000, rc 0) 00000100:00100000:2.0:1787829948.012452:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f99a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+8:11091:x1874675275746048:12345-192.168.201.51@tcp:101:bash.0 Request processed in 258us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829948.012458:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 58 00000100:00100000:3.0:1787829948.016811:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829948.017119:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275746176 00000100:00100000:0.0:1787829948.017133:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275746176 00002000:00010000:0.0:1787829948.017190:0:6657:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1787829948.017195:0:6657:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e9b7f312940 with x1874675275746176 ext(0->18446744073709551615) 00002000:00010000:0.0:1787829948.017213:0:6657:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e9b7f312940. 00000100:00100000:0.0:1787829948.017243:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 5 00000100:00100000:0.0:1787829948.017254:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f312940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b6abf229-545c-43fd-8dee-d9adf582be48+8:2360:x1874675275746176:12345-192.168.201.51@tcp:10:bash.0 00002000:00010000:0.0:1787829948.017634:0:6657:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787829948.017638:0:6657:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787829946 -> 1787829948 00002000:00010000:0.0:1787829948.017640:0:6657:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787829945 -> 1787829945 00002000:00010000:0.0:1787829948.017643:0:6657:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787829946 -> 1787829948 00002000:00010000:0.0:1787829948.017645:0:6657:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787829948.017734:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f312940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b6abf229-545c-43fd-8dee-d9adf582be48+9:2360:x1874675275746176:12345-192.168.201.51@tcp:10:bash.0 Request processed in 480us (937us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787829948.017744:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 5 00002000:00010000:0.0:1787829948.018566:0:6657:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1787829948.018571:0:6657:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e9b7f312940 with x1874675275746176 ext(0->18446744073709551615) 00002000:00010000:0.0:1787829948.018581:0:6657:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e9b7f312940. 00010000:00010000:1.0:1787829948.066332:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829948.102650:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829948.102742:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275746304 00000100:00100000:3.0:1787829948.102757:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275746304 00000100:00100000:3.0:1787829948.103102:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 194 00000100:00100000:3.0:1787829948.103135:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f99a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+32:11571:x1874675275746304:12345-192.168.201.51@tcp:34:lfs.0 00010000:00010000:3.0:1787829948.103241:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d8529 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.103266:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d8529 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.103313:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d8529 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.103334:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8530 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.103342:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.103350:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.103750:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8537 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.103761:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.103768:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787829948.103833:0:10044:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.103847:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d8529 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.103863:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d8529 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.103886:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d8529 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.103893:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74898e00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829948.103899:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d8529 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.103908:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d8529 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.103923:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:3.0:1787829948.103927:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829948.103933:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d8529 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.103940:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d8529 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.103957:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.103964:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8530 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.103971:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8530 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.103977:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74899a00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829948.103986:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8530 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.103993:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8530 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.104000:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e9b478cc300) 00010000:00010000:3.0:1787829948.104003:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829948.104006:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8530 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.104012:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8530 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.104092:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.104098:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8537 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.104104:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8537 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.104109:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74898400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829948.104112:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8537 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.104118:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8537 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.104126:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b478cc900) 00010000:00010000:3.0:1787829948.104128:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829948.104138:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8537 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.104145:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8537 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829948.104247:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f99a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+32:11571:x1874675275746304:12345-192.168.201.51@tcp:34:lfs.0 Request processed in 1113us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829948.104259:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 194 00000100:00100000:2.0:1787829948.142361:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829948.142532:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275746560 00000100:00100000:3.0:1787829948.142545:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275746560 00000100:00100000:3.0:1787829948.142625:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 195 00000100:00100000:3.0:1787829948.142635:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52389a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+32:11574:x1874675275746560:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:3.0:1787829948.142661:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829948.142685:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d853e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8a64 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.142765:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8545 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.142781:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8545 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.142790:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8545 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.142801:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d854c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.142806:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d854c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.143566:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d854c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.144537:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d8553 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.144556:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d8553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.144575:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d8553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787829948.144589:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787829948.144705:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8545 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.144711:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8545 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.144716:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8545 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.144720:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74899a00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829948.144725:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8545 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.144731:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8545 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.144742:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:2.0:1787829948.144745:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829948.144748:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8545 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.144752:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8545 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.144762:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d854c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.144766:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d854c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.144775:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d854c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.144778:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74898e00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829948.144780:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d854c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.144783:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d854c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.144787:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e9b478cc300) 00010000:00010000:2.0:1787829948.144788:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829948.144790:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d854c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.144793:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d854c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.144853:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d853e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a64 expref: 35 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.144869:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d8553 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a64 expref: 34 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.144875:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b478cc900) 00010000:00010000:2.0:1787829948.144877:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787829948.144878:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3e000, rc 0) 00000100:00100000:2.0:1787829948.145093:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52389a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+34:11574:x1874675275746560:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 2458us (2742us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1787829948.145108:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 195 00000100:00100000:0.0:1787829948.148395:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829948.149644:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275746688 00000100:00100000:2.0:1787829948.149662:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275746688 00000100:00100000:2.0:1787829948.149786:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 196 00000100:00100000:2.0:1787829948.149799:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f999a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+34:11574:x1874675275746688:12345-192.168.201.51@tcp:54:lfs.0 00010000:00010000:2.0:1787829948.149927:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d8561 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.149949:0:7257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d8506 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a4f expref: 34 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.149961:0:7257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d8561 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.150011:0:7257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d8506 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a4f expref: 34 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.150053:0:7257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d8506 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a4f expref: 34 pid: 10044 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829948.150071:0:7257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed2580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7257:1874675284126336:192.168.201.51@tcp:104: 00000100:00100000:2.0:1787829948.150211:0:7257:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b75d9c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787829948.153781:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829948.154265:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275746944 00000100:00100000:3.0:1787829948.154287:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275746944 00000100:00100000:3.0:1787829948.154366:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 52 00000100:00100000:3.0:1787829948.154379:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f99b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+35:5598:x1874675275746944:12345-192.168.201.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787829948.154798:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f99b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+36:5598:x1874675275746944:12345-192.168.201.51@tcp:35:ldlm_bl.0 Request processed in 419us (1031us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1787829948.154807:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 52 00000100:00100000:2.0:1787829948.155384:0:7257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed2580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7257:1874675284126336:192.168.201.51@tcp:104: 00010000:00010000:2.0:1787829948.155418:0:7257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d8561 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829948.157955:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829948.158165:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275747072 00000100:00100000:2.0:1787829948.158195:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275747072 00010000:00010000:2.0:1787829948.158246:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d8506 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a4f expref: 36 pid: 10044 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829948.158304:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 76 00000100:00100000:2.0:1787829948.158316:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b4fae6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+36:2363:x1874675275747072:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787829948.158338:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829948.158346:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d8506 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a4f expref: 36 pid: 10044 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.158361:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d8506 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a4f expref: 36 pid: 10044 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.158388:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d8506 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a4f expref: 36 pid: 10044 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.158407:0:8409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b478cc900) 00010000:00010000:2.0:1787829948.158414:0:8409:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d8561 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.158423:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d8561 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.158432:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d8561 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.158469:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787829948.158546:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b4fae6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+35:2363:x1874675275747072:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 231us (686us total) trans 0 rc 0/0 00010000:00010000:3.0:1787829948.159534:0:7257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d8561 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.159550:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d8561 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.159594:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d8561 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.159601:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d8561 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.159608:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d8561 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.159614:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3e600 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829948.159619:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d8561 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.159643:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d8561 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.159659:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b478cc900) 00010000:00010000:3.0:1787829948.159662:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787829948.159668:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d8561 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.159674:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e600/0xc03b4d103c0d8561 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829948.159761:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f999a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+35:11574:x1874675275746688:12345-192.168.201.51@tcp:54:lfs.0 Request processed in 9962us (11379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829948.159773:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 196 00000100:00100000:2.0:1787829948.160358:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 76 00000100:00100000:3.0:1787829948.163060:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829948.163157:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275747328 00000100:00100000:2.0:1787829948.163171:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275747328 00000100:00100000:2.0:1787829948.163243:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 53 00000100:00100000:2.0:1787829948.163256:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f313840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+34:11574:x1874675275747328:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:2.0:1787829948.163582:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f313840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+35:11574:x1874675275747328:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 328us (567us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1787829948.163592:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 53 00000100:00100000:1.0:1787829948.245963:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829948.246337:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275747584 00000100:00100000:3.0:1787829948.246352:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275747584 00000100:00100000:3.0:1787829948.246449:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 197 00000100:00100000:3.0:1787829948.246463:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+35:11585:x1874675275747584:12345-192.168.201.51@tcp:101:cat.0 00010000:00010000:3.0:1787829948.246500:0:10044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829948.246531:0:10044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899e00/0xc03b4d103c0d8568 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8a6b expref: -99 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.246642:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899200/0xc03b4d103c0d856f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.246663:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899200/0xc03b4d103c0d856f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.246698:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899200/0xc03b4d103c0d856f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.246719:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8576 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.246726:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8576 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.246732:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8576 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.247260:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d857d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.247282:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d857d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.247290:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d857d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829948.247300:0:10044:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1787829948.247430:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899200/0xc03b4d103c0d856f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.247439:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899200/0xc03b4d103c0d856f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.247447:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899200/0xc03b4d103c0d856f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.247454:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74899200 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829948.247466:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899200/0xc03b4d103c0d856f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.247476:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899200/0xc03b4d103c0d856f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.247490:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:3.0:1787829948.247494:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829948.247499:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899200/0xc03b4d103c0d856f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.247506:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899200/0xc03b4d103c0d856f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.247521:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8576 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.247528:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8576 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.247534:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8576 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.247539:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74898400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829948.247542:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8576 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.247548:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8576 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.247555:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e9b478cc200) 00010000:00010000:3.0:1787829948.247557:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829948.247567:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8576 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.247574:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8576 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.247630:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899e00/0xc03b4d103c0d8568 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a6b expref: 38 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.247646:0:10044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d857d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a6b expref: 37 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.247654:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b478cc900) 00010000:00010000:3.0:1787829948.247657:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787829948.247660:0:10044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74898e00, rc 0) 00000100:00100000:3.0:1787829948.247750:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+37:11585:x1874675275747584:12345-192.168.201.51@tcp:101:cat.0 Request processed in 1290us (1813us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1787829948.247760:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 197 00000100:00100000:1.0:1787829948.255877:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829948.256180:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275747840 00000100:00100000:2.0:1787829948.256194:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275747840 00000100:00100000:2.0:1787829948.256490:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 54 00000100:00100000:2.0:1787829948.256504:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+37:11585:x1874675275747840:12345-192.168.201.51@tcp:35:cat.0 00000100:00100000:2.0:1787829948.256870:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+38:11585:x1874675275747840:12345-192.168.201.51@tcp:35:cat.0 Request processed in 367us (1007us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1787829948.256880:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 54 00000100:00100000:3.0:1787829948.265092:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f313c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284126464:0@lo:400:kworker.0 00000100:00100000:3.0:1787829948.265202:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829948.265241:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284126464 00000100:00100000:0.0:1787829948.265252:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284126464 00000100:00100000:3.0:1787829948.265266:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f311680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284126976:0@lo:400:kworker.0 00000100:00100000:3.0:1787829948.265311:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829948.265350:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787829948.265355:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284126592:0@lo:400:kworker.0 00000100:00100000:3.0:1787829948.265377:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829948.265394:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f311e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284127104:0@lo:400:kworker.0 00000100:00100000:3.0:1787829948.265419:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829948.265475:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f312580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284126720:0@lo:400:kworker.0 00000100:00100000:3.0:1787829948.265500:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829948.265519:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787829948.265523:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f310000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284126848:0@lo:400:kworker.0 00000100:00100000:3.0:1787829948.265544:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829948.265574:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284127104 00000100:00100000:3.0:1787829948.265578:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284127104 00000100:00100000:3.0:1787829948.266150:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284126848 00000100:00100000:3.0:1787829948.266155:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284126848 00000100:00100000:3.0:1787829948.266191:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787829948.266201:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3278:x1874675284127104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829948.266279:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3278:x1874675284127104:12345-0@lo:400:kworker.0 Request processed in 69us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829948.266289:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787829948.266306:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787829948.266312:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f310b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3280:x1874675284126848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829948.266345:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f310b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3280:x1874675284126848:12345-0@lo:400:kworker.0 Request processed in 32us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829948.266350:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1787829948.266382:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787829948.266386:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787829948.266425:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f310000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284126848:0@lo:400:kworker.0 00000100:00100000:3.0:1787829948.266459:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f311e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284127104:0@lo:400:kworker.0 00000100:00100000:3.0:1787829948.266485:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284126976 00000100:00100000:3.0:1787829948.266488:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284126976 00000100:00100000:0.0:1787829948.266521:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1787829948.266533:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284126592 00000100:00100000:0.0:1787829948.266534:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69d13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3278:x1874675284126464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829948.266538:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284126592 00000100:00100000:3.0:1787829948.266574:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284126720 00000100:00100000:3.0:1787829948.266578:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284126720 00000100:00100000:0.0:1787829948.266594:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69d13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3278:x1874675284126464:12345-0@lo:400:kworker.0 Request processed in 63us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829948.266602:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787829948.266606:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787829948.266655:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f313c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284126464:0@lo:400:kworker.0 00000100:00100000:0.0:1787829948.266685:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787829948.266693:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f310780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284126592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829948.266731:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f310780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284126592:12345-0@lo:400:kworker.0 Request processed in 39us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829948.266737:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787829948.266750:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787829948.266756:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284126720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829948.266789:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284126720:12345-0@lo:400:kworker.0 Request processed in 34us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829948.266795:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787829948.266819:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f312580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284126720:0@lo:400:kworker.0 00000100:00100000:1.0:1787829948.268661:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284126592:0@lo:400:kworker.0 00000100:00100000:3.0:1787829948.268730:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f312d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1874675284126976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829948.268819:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787829948.268839:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284127232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787829948.268889:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829948.268935:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284127232 00000100:00100000:1.0:1787829948.268942:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284127232 00000100:00100000:1.0:1787829948.268995:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787829948.269004:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1874675284127232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787829948.269087:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787829948.269131:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1874675284127232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829948.269139:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787829948.269183:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284127232:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787829948.269228:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787829948.269258:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f311680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284126976:0@lo:400:kworker.0 00000100:00100000:3.0:1787829948.269481:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f312d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1874675284126976:12345-0@lo:400:kworker.0 Request processed in 2245us (3542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829948.269493:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787829948.275600:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829948.275713:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275748096 00000100:00100000:0.0:1787829948.275726:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275748096 00000100:00100000:0.0:1787829948.275805:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 198 00000100:00100000:0.0:1787829948.275816:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ed2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+38:11586:x1874675275748096:12345-192.168.201.51@tcp:36:rm.0 00010000:00010000:0.0:1787829948.275918:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787829948.276405:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898e00/0xc03b4d103c0d857d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a6b expref: 38 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.276437:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d8553 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a64 expref: 37 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.276451:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d851b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a56 expref: 36 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.276464:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b478cc900) 00010000:00010000:0.0:1787829948.276480:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787829948.276512:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f800/0xc03b4d103c0d858b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.276531:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f800/0xc03b4d103c0d858b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.276544:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f800/0xc03b4d103c0d858b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.276561:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ee00/0xc03b4d103c0d8592 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.276570:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ee00/0xc03b4d103c0d8592 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.276599:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ee00/0xc03b4d103c0d8592 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.279708:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d8599 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.279736:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d8599 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.279750:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d8599 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787829948.280992:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1787829948.281006:0:5806:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 328181987430ns, next at 329181984666ns, rc = 0 00010000:00010000:1.0:1787829948.282750:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d85a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.282777:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d85a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.282791:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d85a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.282801:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d85a0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.285247:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d85a0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.285487:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d85a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.285529:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787829948.285568:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d8599 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.285574:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d8599 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.285582:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d8599 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.285588:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feef200 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829948.285593:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d8599 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.285602:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d8599 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.285622:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7e00) 00010000:00010000:1.0:1787829948.285626:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787829948.285632:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d8599 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.285639:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d8599 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.285670:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f800/0xc03b4d103c0d858b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.285697:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f800/0xc03b4d103c0d858b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.285703:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f800/0xc03b4d103c0d858b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.285709:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7f800 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829948.285712:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f800/0xc03b4d103c0d858b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.285719:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f800/0xc03b4d103c0d858b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.285728:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:1.0:1787829948.285730:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829948.285734:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f800/0xc03b4d103c0d858b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.285740:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f800/0xc03b4d103c0d858b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787829948.285760:0:5806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca9d6e22 reply state 000000004a46fcba transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ee00/0xc03b4d103c0d8592 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829948.285771:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787829948.287237:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787829948.287252:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d85a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.287335:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feee400 already unused, calling callback (ffffffffc1651420) 00010000:00010000:3.0:1787829948.287339:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d85a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.287349:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d85a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.287367:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e9b507a7e00) 00010000:00010000:3.0:1787829948.287370:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787829948.287375:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d85a0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.287912:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d85a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.288641:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829948.288646:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829948.288649:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829948.290190:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ed2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+37:11586:x1874675275748096:12345-192.168.201.51@tcp:36:rm.0 Request processed in 14360us (14593us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1787829948.290207:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 198 00010000:00010000:2.0:1787829948.294981:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ee00/0xc03b4d103c0d8592 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.295003:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ee00/0xc03b4d103c0d8592 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.295013:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ee00/0xc03b4d103c0d8592 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.295045:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7ee00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829948.295057:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ee00/0xc03b4d103c0d8592 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.295086:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ee00/0xc03b4d103c0d8592 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.295109:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e9b48f25d00) 00010000:00010000:2.0:1787829948.295113:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829948.295118:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ee00/0xc03b4d103c0d8592 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.295125:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ee00/0xc03b4d103c0d8592 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829948.348844:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829948.348994:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275748352 00000100:00100000:1.0:1787829948.349008:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275748352 00000100:00100000:1.0:1787829948.349152:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 199 00000100:00100000:1.0:1787829948.349164:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ed1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+36:11592:x1874675275748352:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:1.0:1787829948.349202:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829948.349229:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d85a7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8a72 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.349417:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d85ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.349437:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d85ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.349450:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d85ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.349467:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d85b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.349475:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d85b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.349481:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d85b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787829948.350179:0:5805:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1787829948.350400:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d85bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.350412:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d85bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.350422:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d85bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.350474:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d85ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.350482:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d85ae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.350490:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d85ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.350497:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feee400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829948.350502:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d85ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.350511:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d85ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.350524:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:1.0:1787829948.350528:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829948.350534:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d85ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.350541:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d85ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787829948.350556:0:5805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a41d49e7 reply state 000000006cfb4917 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d85b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829948.350566:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787829948.350604:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d85a7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a72 expref: 39 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.350633:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d85bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a72 expref: 38 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.350641:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b507a7a00) 00010000:00010000:1.0:1787829948.350644:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787829948.350646:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feeea00, rc 0) 00000100:00100000:1.0:1787829948.350726:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ed1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+39:11592:x1874675275748352:12345-192.168.201.51@tcp:101:bash.0 Request processed in 1564us (1899us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1787829948.350735:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 199 00000100:00100000:1.0:1787829948.353773:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829948.353881:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275748480 00000100:00100000:2.0:1787829948.353893:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275748480 00000100:00100000:2.0:1787829948.353980:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 59 00000100:00100000:2.0:1787829948.353991:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+5:2360:x1874675275748480:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:2.0:1787829948.354051:0:6651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829948.354085:0:6651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d85ca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8a79 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787829948.354118:0:6651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787829948.354143:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=328s v=(0 0) 00010000:00010000:2.0:1787829948.354148:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787829948.354161:0:6651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d85ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a79 expref: 6 pid: 6651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.354184:0:6651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d85ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a79 expref: 6 pid: 6651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787829948.354322:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787829948.354381:0:6651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3f600, rc 0) 00000100:00100000:2.0:1787829948.354453:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+6:2360:x1874675275748480:12345-192.168.201.51@tcp:101:bash.0 Request processed in 463us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829948.354462:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 59 00010000:00010000:0.0:1787829948.356198:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d85b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.356219:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d85b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.356227:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d85b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.356234:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feeee00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829948.356239:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d85b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.356247:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d85b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.356277:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e9b507a7200) 00010000:00010000:0.0:1787829948.356281:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787829948.356288:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d85b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.356295:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d85b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829948.357601:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829948.357691:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275748608 00000100:00100000:3.0:1787829948.357702:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275748608 00000100:00100000:3.0:1787829948.357780:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 60 00000100:00100000:3.0:1787829948.357792:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f99b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+6:11592:x1874675275748608:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:3.0:1787829948.357826:0:6650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829948.357846:0:6650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091bc2bf3/0xc03b4d103c0d85d1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8a80 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.357881:0:6650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d85ca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a79 expref: 7 pid: 6651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.357891:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787829948.357895:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787829948.357901:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091bc2bf3/0xc03b4d103c0d85d1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a80 expref: 7 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.357944:0:6650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d85ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a79 expref: 7 pid: 6651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.357958:0:6650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d85ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a79 expref: 7 pid: 6651 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829948.357981:0:6650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f311e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6650:1874675284127360:192.168.201.51@tcp:104: 00000100:00100000:3.0:1787829948.358396:0:6650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b44d20e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787829948.364767:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829948.364908:0:6650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f311e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6650:1874675284127360:192.168.201.51@tcp:104: 00010000:00010000:3.0:1787829948.365012:0:6650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000091bc2bf3/0xc03b4d103c0d85d1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a80 expref: 7 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.365095:0:6650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74899e00, rc 0) 00000100:00100000:3.0:1787829948.365174:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f99b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+7:11592:x1874675275748608:12345-192.168.201.51@tcp:101:bash.0 Request processed in 7384us (7581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829948.365185:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 60 00000100:00100000:2.0:1787829948.372447:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275748736 00000100:00100000:2.0:1787829948.372469:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275748736 00010000:00010000:2.0:1787829948.372547:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d85ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a79 expref: 7 pid: 6651 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829948.372686:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 77 00000100:00100000:2.0:1787829948.372698:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+7:2362:x1874675275748736:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787829948.372722:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829948.372753:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d85ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a79 expref: 7 pid: 6651 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.372770:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d85ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a79 expref: 7 pid: 6651 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.372802:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d85ca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a79 expref: 7 pid: 6651 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.372824:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787829948.372830:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787829948.372839:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000091bc2bf3/0xc03b4d103c0d85d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a80 expref: 6 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.372873:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091bc2bf3/0xc03b4d103c0d85d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a80 expref: 6 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.372928:0:5790:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000091bc2bf3/0xc03b4d103c0d85d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a80 expref: 6 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829948.372947:0:5790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f30c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5790:1874675284127488:192.168.201.51@tcp:105: 00000100:00100000:2.0:1787829948.373130:0:5790:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b75d9c180 going to sleep for 11 seconds 00000100:00100000:2.0:1787829948.384161:0:5790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f30c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5790:1874675284127488:192.168.201.51@tcp:105: 00010000:00010000:2.0:1787829948.384199:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787829948.384282:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+6:2362:x1874675275748736:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 11584us (19528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829948.384297:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 77 00000100:00100000:0.0:1787829948.387408:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829948.388904:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275748992 00000100:00100000:2.0:1787829948.388919:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275748992 00000100:00100000:2.0:1787829948.389323:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 55 00000100:00100000:0.0:1787829948.389497:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74e19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+38:11592:x1874675275748992:12345-192.168.201.51@tcp:35:bash.0 00000100:00100000:0.0:1787829948.390011:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74e19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+39:11592:x1874675275748992:12345-192.168.201.51@tcp:35:bash.0 Request processed in 675us (2614us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1787829948.399462:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 55 00000100:00100000:1.0:1787829948.524436:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829948.524903:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275749120 00000100:00100000:3.0:1787829948.524916:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275749120 00000100:00100000:3.0:1787829948.525475:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 200 00000100:00100000:3.0:1787829948.525489:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+39:11608:x1874675275749120:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:3.0:1787829948.525525:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829948.525551:0:7257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d85d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8a87 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.525640:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899200/0xc03b4d103c0d85df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.525655:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899200/0xc03b4d103c0d85df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.525665:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899200/0xc03b4d103c0d85df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829948.525736:0:7257:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787829948.525739:0:7257:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787829948.525758:0:7257:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899200/0xc03b4d103c0d85df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.525783:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d85d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a87 expref: 41 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.525833:0:7257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899200/0xc03b4d103c0d85df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a87 expref: 40 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.525840:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:3.0:1787829948.525843:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787829948.525846:0:7257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74899200, rc 0) 00000100:00100000:3.0:1787829948.525933:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+40:11608:x1874675275749120:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 443us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829948.525940:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 200 00000100:00100000:1.0:1787829948.530665:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829948.530739:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275749376 00000100:00100000:0.0:1787829948.530755:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275749376 00000100:00100000:0.0:1787829948.531100:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 201 00000100:00100000:0.0:1787829948.531114:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+40:11608:x1874675275749376:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:0.0:1787829948.531144:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829948.531177:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d85e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8a8e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.531334:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d85ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.531352:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d85ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.531366:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d85ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787829948.531380:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787829948.531567:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d85e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a8e expref: 43 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.531593:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d85ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a8e expref: 42 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.531613:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b507a7a00) 00010000:00010000:0.0:1787829948.531629:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787829948.531635:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7fa7e400, rc 0) 00000100:00100000:0.0:1787829948.531722:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+42:11608:x1874675275749376:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 611us (1070us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1787829948.531731:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 201 00000100:00100000:0.0:1787829948.535917:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829948.536101:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275749504 00000100:00100000:1.0:1787829948.536115:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275749504 00000100:00100000:0.0:1787829948.536335:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829948.536577:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275749760 00000100:00100000:3.0:1787829948.536584:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275749760 00000100:00100000:3.0:1787829948.536644:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 202 00000100:00100000:3.0:1787829948.536656:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74e183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+43:11608:x1874675275749760:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:3.0:1787829948.536682:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829948.536709:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d85fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8a95 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.537138:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8602 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.537159:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8602 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.537172:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8602 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829948.537186:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00000100:00100000:1.0:1787829948.537665:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 14 00000100:00100000:1.0:1787829948.537680:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74e192c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6abf229-545c-43fd-8dee-d9adf582be48+45:2363:x1874675275749504:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787829948.537695:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829948.537721:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e400/0xc03b4d103c0d85ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a8e expref: 45 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.537743:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b507a7a00) 00010000:00010000:1.0:1787829948.537750:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829948.538084:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74e192c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6abf229-545c-43fd-8dee-d9adf582be48+44:2363:x1874675275749504:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 408us (2180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829948.538106:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 14 00010000:00010000:3.0:1787829948.538184:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d85fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a95 expref: 44 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.538204:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8602 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a95 expref: 43 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.538213:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b507a7a00) 00010000:00010000:3.0:1787829948.538217:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787829948.538220:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74899a00, rc 0) 00000100:00100000:3.0:1787829948.538250:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74e183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+43:11608:x1874675275749760:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 1598us (1916us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1787829948.538257:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 202 00000100:00100000:1.0:1787829948.545525:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829948.545643:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275749888 00000100:00100000:2.0:1787829948.545658:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275749888 00000100:00100000:2.0:1787829948.545734:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 61 00000100:00100000:2.0:1787829948.545744:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa19a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+6:2363:x1874675275749888:12345-192.168.201.51@tcp:1:lfs.0 00010000:00010000:2.0:1787829948.545801:0:6651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8610 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.545834:0:6651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091bc2bf3/0xc03b4d103c0d85d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a80 expref: 6 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.545870:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787829948.545875:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787829948.545881:0:6651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8610 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.545924:0:6651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091bc2bf3/0xc03b4d103c0d85d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a80 expref: 6 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.545937:0:6651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091bc2bf3/0xc03b4d103c0d85d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a80 expref: 6 pid: 6650 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829948.545951:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6651:1874675284127616:192.168.201.51@tcp:104: 00000100:00100000:2.0:1787829948.546109:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b75d9c180 going to sleep for 11 seconds 00000100:00100000:2.0:1787829948.548212:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6651:1874675284127616:192.168.201.51@tcp:104: 00000100:00100000:0.0:1787829948.548216:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00010000:00010000:2.0:1787829948.548248:0:6651:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8610 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829948.548305:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275750016 00000100:00100000:1.0:1787829948.548314:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275750016 00002000:00100000:1.0:1787829948.548380:0:6655:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9e9b74e18000 x1874675275750016/t0(0) o4->b6abf229-545c-43fd-8dee-d9adf582be48@192.168.201.51@tcp:529/0 lens 504/0 e 0 to 0 dl 1787829959 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787829948.548392:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e9b74e18000 with x1874675275750016 ext(0->8) 00010000:00010000:1.0:1787829948.548400:0:6655:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000091bc2bf3/0xc03b4d103c0d85d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a80 expref: 7 pid: 6650 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.548416:0:6655:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000091bc2bf3/0xc03b4d103c0d85d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a80 expref: 7 pid: 6650 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787829948.548424:0:6655:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e9b74e18000 00000100:00100000:1.0:1787829948.548556:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 3 00000100:00100000:1.0:1787829948.548569:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b6abf229-545c-43fd-8dee-d9adf582be48+7:2363:x1874675275750016:12345-192.168.201.51@tcp:4:lfs.0 00000100:00100000:1.0:1787829948.549224:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b6abf229-545c-43fd-8dee-d9adf582be48+9:2363:x1874675275750016:12345-192.168.201.51@tcp:4:lfs.0 Request processed in 655us (1007us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787829948.549231:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 3 00002000:00100000:1.0:1787829948.549237:0:6655:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9e9b74e18000 x1874675275750016/t4294967308(0) o4->b6abf229-545c-43fd-8dee-d9adf582be48@192.168.201.51@tcp:529/0 lens 504/448 e 0 to 0 dl 1787829959 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787829948.549244:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e9b74e18000 with x1874675275750016 ext(0->8) 00010000:00010000:1.0:1787829948.549249:0:6655:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000091bc2bf3/0xc03b4d103c0d85d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a80 expref: 9 pid: 6650 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.549283:0:6655:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000091bc2bf3/0xc03b4d103c0d85d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a80 expref: 9 pid: 6650 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787829948.549292:0:6655:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e9b74e18000 00000100:00100000:0.0:1787829948.552139:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829948.552542:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275750144 00000100:00100000:1.0:1787829948.552557:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275750144 00010000:00010000:1.0:1787829948.552618:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091bc2bf3/0xc03b4d103c0d85d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a80 expref: 9 pid: 6650 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829948.552672:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 78 00000100:00100000:1.0:1787829948.552683:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74e18f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+9:2363:x1874675275750144:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787829948.552703:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787829948.552728:0:5792:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787829948.552731:0:5792:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787829948 00002000:00010000:1.0:1787829948.552733:0:5792:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787829949 00002000:00010000:1.0:1787829948.552736:0:5792:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787829948 00010000:00010000:1.0:1787829948.552741:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091bc2bf3/0xc03b4d103c0d85d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a80 expref: 9 pid: 6650 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.552756:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091bc2bf3/0xc03b4d103c0d85d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a80 expref: 9 pid: 6650 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.552785:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091bc2bf3/0xc03b4d103c0d85d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a80 expref: 9 pid: 6650 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.553312:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787829948.553317:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787829948.553325:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8610 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.553339:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8610 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.553462:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829948.553535:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74e18f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+8:2363:x1874675275750144:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 852us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829948.553544:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 78 00010000:00010000:2.0:1787829948.553759:0:6651:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8610 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.553770:0:6651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8610 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.553808:0:6651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8610 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.554645:0:6651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8610 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.554660:0:6651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8610 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.554668:0:6651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f600 already unused, calling callback (ffffffffc1651420) 00010000:00010000:2.0:1787829948.554673:0:6651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8610 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.554684:0:6651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8610 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.554708:0:6651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8610 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.554718:0:6651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8610 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829948.555339:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa19a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+7:2363:x1874675275749888:12345-192.168.201.51@tcp:1:lfs.0 Request processed in 9590us (9835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829948.555351:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 61 00000100:00100000:0.0:1787829948.559764:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829948.559877:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275750400 00000100:00100000:3.0:1787829948.559891:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275750400 00000100:00100000:3.0:1787829948.559963:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 56 00000100:00100000:3.0:1787829948.559975:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b50363850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+43:11608:x1874675275750400:12345-192.168.201.51@tcp:35:lfs.0 00000004:00010000:3.0:1787829948.560119:0:5807:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8602 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a95 expref: 43 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787829948.560834:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1787829948.560899:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1787829948.561806:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1787829948.561949:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8617 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.563428:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d85bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a72 expref: 47 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.563449:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8617 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.563535:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d85bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a72 expref: 47 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.563556:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d85bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a72 expref: 47 pid: 5805 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829948.563577:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f311e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5807:1874675284127744:192.168.201.51@tcp:104: 00000100:00100000:3.0:1787829948.563703:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b44d20e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787829948.568494:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f311e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5807:1874675284127744:192.168.201.51@tcp:104: 00010000:00010000:3.0:1787829948.568544:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8617 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829948.568692:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829948.568932:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275750528 00000100:00100000:2.0:1787829948.568942:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275750528 00010000:00010000:2.0:1787829948.569479:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d85bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a72 expref: 48 pid: 5805 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829948.569580:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 79 00000100:00100000:2.0:1787829948.569591:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+48:2363:x1874675275750528:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787829948.569612:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829948.569620:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d85bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a72 expref: 48 pid: 5805 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.569633:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d85bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a72 expref: 48 pid: 5805 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.569661:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d85bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a72 expref: 48 pid: 5805 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.569683:0:8409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b507a7a00) 00010000:00010000:2.0:1787829948.569688:0:8409:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8617 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.569700:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8617 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.569708:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8617 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.569738:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787829948.569804:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+47:2363:x1874675275750528:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 215us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829948.569813:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 79 00010000:00010000:3.0:1787829948.569874:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8617 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.569883:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8617 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787829948.570066:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1787829948.570311:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1787829948.570457:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f311e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5807:1874675284127872:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787829948.570520:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829948.570566:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284127872 00000100:00100000:3.0:1787829948.570573:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284127872 00000100:00100000:3.0:1787829948.570604:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787829948.570611:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5807:x1874675284127872:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787829948.570680:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5807:x1874675284127872:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 70us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829948.570693:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787829948.570713:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b508a5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787829948.570741:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f311e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5807:1874675284127872:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787829948.571219:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1787829948.571286:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f311e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5807:1874675284128000:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787829948.571317:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829948.571339:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284128000 00000100:00100000:3.0:1787829948.571342:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284128000 00000100:00100000:3.0:1787829948.571359:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787829948.571364:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f312580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5807:x1874675284128000:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787829948.571491:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f312580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5807:x1874675284128000:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 126us (173us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787829948.571498:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787829948.571514:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b44d20e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787829948.571531:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f311e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5807:1874675284128000:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787829948.571569:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1787829948.571600:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8617 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.571609:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8617 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.571616:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8617 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.571623:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74898400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829948.571628:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8617 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.571644:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8617 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.571662:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b507a7a00) 00010000:00010000:3.0:1787829948.571665:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787829948.571670:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8617 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.571677:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d8617 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787829948.571840:0:5807:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787829948.571943:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1787829948.571954:0:5807:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 328472935928ns, next at 329472934050ns, rc = 0 00000001:00080000:3.0:1787829948.571959:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1787829948.571987:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b507a7a00) 00010000:00010000:3.0:1787829948.571990:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787829948.571997:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d8602 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a95 expref: 51 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829948.572117:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b50363850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+50:11608:x1874675275750400:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 12145us (12372us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1787829948.572126:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 56 00000020:00080000:3.0:1787829948.572129:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787829948.575684:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829948.575783:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275750656 00000100:00100000:3.0:1787829948.575796:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275750656 00000100:00100000:3.0:1787829948.576375:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 203 00000100:00100000:3.0:1787829948.576401:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+50:11608:x1874675275750656:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:3.0:1787829948.576453:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829948.576482:0:7257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d861e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8a9c expref: -99 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.576562:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d861e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a9c expref: 51 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.576579:0:7257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d861e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a9c expref: 51 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.576603:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:3.0:1787829948.576606:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787829948.576612:0:7257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74898400, rc 0) 00000100:00100000:3.0:1787829948.576694:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+51:11608:x1874675275750656:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 299us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829948.576703:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 203 00000100:00100000:0.0:1787829948.579926:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829948.580114:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275750912 00000100:00100000:2.0:1787829948.580150:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275750912 00000100:00100000:2.0:1787829948.580221:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 57 00000100:00100000:2.0:1787829948.580232:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74e19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+51:11608:x1874675275750912:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:2.0:1787829948.582726:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74e19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+52:11608:x1874675275750912:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 2479us (2799us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1787829948.582743:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 57 00000100:00100000:2.0:1787829948.651392:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829948.651507:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275751040 00000100:00100000:0.0:1787829948.651530:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275751040 00000100:00100000:0.0:1787829948.651620:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 204 00000100:00100000:0.0:1787829948.651633:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+52:11618:x1874675275751040:12345-192.168.201.51@tcp:34:lfs.0 00010000:00010000:0.0:1787829948.651739:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d8625 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.651760:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d8625 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.651773:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d8625 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.651790:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d862c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.651797:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d862c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.651825:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d862c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.652255:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d8633 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.652277:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d8633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.652286:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d8633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787829948.652340:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d8633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.652356:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d8625 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.652363:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d8625 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.652371:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d8625 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.652376:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7f000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829948.652381:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d8625 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.652389:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d8625 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.652403:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:0.0:1787829948.652415:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787829948.652421:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d8625 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.652428:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d8625 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.652442:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d862c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.652448:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d862c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.652454:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d862c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.652459:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7e200 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829948.652462:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d862c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.652468:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d862c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.652476:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e9b48f25700) 00010000:00010000:0.0:1787829948.652479:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787829948.652482:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d862c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.652488:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d862c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.652505:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d8633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.652585:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d8633 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.652592:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d8633 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.652599:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7ea00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829948.652656:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d8633 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.652665:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d8633 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.652674:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:0.0:1787829948.652677:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787829948.652680:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d8633 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.652685:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ea00/0xc03b4d103c0d8633 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829948.652845:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+52:11618:x1874675275751040:12345-192.168.201.51@tcp:34:lfs.0 Request processed in 1213us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829948.652863:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 204 00000100:00100000:0.0:1787829948.689169:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829948.689257:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275751296 00000100:00100000:3.0:1787829948.689280:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275751296 00000100:00100000:3.0:1787829948.689359:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 205 00000100:00100000:3.0:1787829948.689369:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74e1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+52:11621:x1874675275751296:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:3.0:1787829948.689400:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829948.689428:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d863a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8aa3 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.689528:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d8641 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.689546:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d8641 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.689580:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d8641 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.689599:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d8648 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.689608:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d8648 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.689615:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d8648 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.689792:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d864f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.689811:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d864f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.689819:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d864f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829948.689830:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787829948.689969:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d8641 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.689978:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d8641 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.689985:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d8641 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.689992:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74899800 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829948.690004:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d8641 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.690012:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d8641 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.690081:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:3.0:1787829948.690085:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829948.690091:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d8641 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.690098:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d8641 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.690116:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d8648 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.690122:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d8648 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.690129:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d8648 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.690135:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74898000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829948.690138:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d8648 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.690144:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d8648 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.690152:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e9b478cc700) 00010000:00010000:3.0:1787829948.690155:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829948.690166:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d8648 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.690172:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d8648 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.690228:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d863a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8aa3 expref: 55 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.690244:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d864f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8aa3 expref: 54 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.690253:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:3.0:1787829948.690255:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787829948.690258:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74899400, rc 0) 00000100:00100000:3.0:1787829948.690362:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74e1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+54:11621:x1874675275751296:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 993us (1204us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1787829948.690372:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 205 00000100:00100000:1.0:1787829948.693833:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829948.693894:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275751424 00000100:00100000:3.0:1787829948.693908:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275751424 00000100:00100000:3.0:1787829948.693985:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 206 00000100:00100000:3.0:1787829948.693998:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+54:11621:x1874675275751424:12345-192.168.201.51@tcp:54:lfs.0 00010000:00010000:3.0:1787829948.694134:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d865d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.694156:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d865d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.694171:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d865d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.694231:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d865d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.694240:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d865d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.694247:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d865d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.694253:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74899600 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829948.694258:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d865d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.694276:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d865d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.694290:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:3.0:1787829948.694293:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787829948.694299:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d865d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.694306:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d865d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829948.694389:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+54:11621:x1874675275751424:12345-192.168.201.51@tcp:54:lfs.0 Request processed in 393us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829948.694398:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 206 00000100:00100000:2.0:1787829948.703600:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829948.705144:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275751680 00000100:00100000:3.0:1787829948.705164:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275751680 00000100:00100000:2.0:1787829948.705403:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 58 00000100:00100000:2.0:1787829948.705415:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+54:11621:x1874675275751680:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:2.0:1787829948.705749:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+55:11621:x1874675275751680:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 335us (2162us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1787829948.705758:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 58 00000100:00100000:0.0:1787829948.759471:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829948.759614:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275751936 00000100:00100000:1.0:1787829948.759624:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275751936 00000100:00100000:1.0:1787829948.759712:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 207 00000100:00100000:1.0:1787829948.759722:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74e1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+55:11631:x1874675275751936:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:1.0:1787829948.759751:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829948.759754:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787829948.759791:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899200/0xc03b4d103c0d85df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a87 expref: 55 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.759826:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:1.0:1787829948.759860:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787829948.759882:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d8664 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8aaa expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.760082:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d866b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.760099:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d864f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8aa3 expref: 55 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.760109:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d866b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.760151:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d864f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8aa3 expref: 55 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.760167:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d864f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8aa3 expref: 55 pid: 5805 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829948.760182:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa18780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1874675284128128:192.168.201.51@tcp:104: 00000100:00100000:1.0:1787829948.760307:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b42bf1180 going to sleep for 11 seconds 00000100:00100000:0.0:1787829948.761900:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa18780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1874675284128128:192.168.201.51@tcp:104: 00010000:00010000:0.0:1787829948.761935:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d866b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829948.763400:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829948.763640:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275752064 00000100:00100000:2.0:1787829948.763651:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275752064 00010000:00010000:2.0:1787829948.763697:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d864f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8aa3 expref: 56 pid: 5805 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829948.763763:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 80 00000100:00100000:2.0:1787829948.763774:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74e1bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+56:2363:x1874675275752064:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787829948.763794:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829948.763809:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d864f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8aa3 expref: 56 pid: 5805 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.763824:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d864f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8aa3 expref: 56 pid: 5805 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.763880:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899400/0xc03b4d103c0d864f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8aa3 expref: 56 pid: 5805 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.763902:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:2.0:1787829948.763908:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d866b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.763919:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d866b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.763927:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d866b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.763966:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787829948.764074:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74e1bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+55:2363:x1874675275752064:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 291us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829948.764084:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 80 00010000:00010000:0.0:1787829948.764167:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d866b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.764176:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d866b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787829948.764200:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787829948.764405:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee200/0xc03b4d103c0d8664 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8aaa expref: 56 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.764424:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d866b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8aaa expref: 55 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.764430:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:0.0:1787829948.764432:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787829948.764434:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feefc00, rc 0) 00000100:00100000:0.0:1787829948.764524:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74e1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+55:11631:x1874675275751936:12345-192.168.201.51@tcp:101:bash.0 Request processed in 4802us (5063us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1787829948.764532:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 207 00000100:00100000:0.0:1787829948.766877:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829948.766968:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275752320 00000100:00100000:1.0:1787829948.766980:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275752320 00000100:00100000:1.0:1787829948.767078:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 208 00000100:00100000:1.0:1787829948.767090:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74e1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+55:11631:x1874675275752320:12345-192.168.201.51@tcp:36:bash.0 00010000:00010000:1.0:1787829948.767437:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d8679 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.767456:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d8679 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.767488:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d8679 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787829948.767554:0:10044:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1787829948.767582:0:10044:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008473deca reply state 00000000196e3cdf transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d8679 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829948.767590:0:10044:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787829948.767684:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74e1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+58:11631:x1874675275752320:12345-192.168.201.51@tcp:36:bash.0 Request processed in 598us (905us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1787829948.767691:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 208 00000020:00080000:1.0:1787829948.767695:0:10044:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787829948.770194:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787829948.770223:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fec70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284128256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787829948.770308:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829948.770355:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284128256 00000100:00100000:2.0:1787829948.770365:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284128256 00000100:00100000:2.0:1787829948.770423:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787829948.770434:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1874675284128256:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787829948.770460:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00002000:00000024:2.0:1787829948.770461:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787829948.770528:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1874675284128256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829948.770537:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787829948.770604:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275752448 00000100:00100000:1.0:1787829948.770618:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fec70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284128256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787829948.770625:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275752448 00010000:00010000:0.0:1787829948.770772:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d8679 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.770784:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d8679 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.770793:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d8679 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.770808:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feeea00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829948.770813:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d8679 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.770823:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d8679 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829948.770935:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 209 00000100:00100000:2.0:1787829948.770944:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+58:11631:x1874675275752448:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:2.0:1787829948.770969:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829948.770992:0:7257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d8680 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8ab1 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.771180:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:0.0:1787829948.771184:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787829948.771234:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8687 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.771405:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d8679 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.771410:0:7257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d866b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8aaa expref: 59 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.771414:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d8679 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.771419:0:7257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8687 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.771452:0:7257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d866b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8aaa expref: 58 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.771468:0:7257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d866b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8aaa expref: 58 pid: 5806 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829948.771479:0:7257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fec4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7257:1874675284128384:192.168.201.51@tcp:104: 00000100:00100000:2.0:1787829948.771603:0:7257:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b75d9c180 going to sleep for 11 seconds 00000100:00100000:2.0:1787829948.773589:0:7257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fec4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7257:1874675284128384:192.168.201.51@tcp:104: 00010000:00010000:2.0:1787829948.773617:0:7257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8687 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829948.773903:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829948.773976:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275752576 00000100:00100000:0.0:1787829948.773985:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275752576 00010000:00010000:0.0:1787829948.774051:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d866b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8aaa expref: 59 pid: 5806 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829948.774716:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 81 00000100:00100000:0.0:1787829948.774732:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa192c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6abf229-545c-43fd-8dee-d9adf582be48+59:2362:x1874675275752576:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787829948.774755:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829948.774765:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d866b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8aaa expref: 59 pid: 5806 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.774779:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d866b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8aaa expref: 59 pid: 5806 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.774840:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d866b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8aaa expref: 59 pid: 5806 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.774866:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:0.0:1787829948.774873:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8687 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.774885:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.774894:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8687 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.774924:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829948.775000:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa192c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6abf229-545c-43fd-8dee-d9adf582be48+58:2362:x1874675275752576:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 273us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829948.775009:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 81 00010000:00010000:3.0:1787829948.775251:0:7257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.775257:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829948.775326:0:7257:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787829948.775332:0:7257:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787829948.775356:0:7257:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.775393:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d8680 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8ab1 expref: 58 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.775411:0:7257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8687 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8ab1 expref: 57 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.775419:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:3.0:1787829948.775421:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787829948.775424:0:7257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3f400, rc 0) 00000100:00100000:3.0:1787829948.776336:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+57:11631:x1874675275752448:12345-192.168.201.51@tcp:101:bash.0 Request processed in 5384us (5867us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829948.776348:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 209 00000100:00100000:1.0:1787829948.778304:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829948.778412:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275752832 00000100:00100000:0.0:1787829948.778423:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275752832 00000100:00100000:1.0:1787829948.778551:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 59 00000100:00100000:1.0:1787829948.778560:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+57:11631:x1874675275752832:12345-192.168.201.51@tcp:35:bash.0 00000100:00100000:1.0:1787829948.778855:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+58:11631:x1874675275752832:12345-192.168.201.51@tcp:35:bash.0 Request processed in 287us (557us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1787829948.778864:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 59 00000100:00100000:1.0:1787829948.827444:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829948.827574:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275752960 00000100:00100000:0.0:1787829948.827585:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275752960 00000100:00100000:0.0:1787829948.827648:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 210 00000100:00100000:0.0:1787829948.827661:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+58:11637:x1874675275752960:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:0.0:1787829948.827695:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829948.827720:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d868e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8ab8 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.827806:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d8695 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.827845:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d8695 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.828446:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d8695 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787829948.828526:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787829948.828530:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787829948.828554:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d8695 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.828587:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e200/0xc03b4d103c0d868e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8ab8 expref: 60 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.828609:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d8695 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8ab8 expref: 59 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.828618:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:0.0:1787829948.828621:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787829948.828625:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7fa7f000, rc 0) 00000100:00100000:0.0:1787829948.828701:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+59:11637:x1874675275752960:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 1043us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829948.828709:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 210 00000100:00100000:3.0:1787829948.832772:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829948.833723:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275753088 00000100:00100000:1.0:1787829948.833761:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275753088 00000100:00100000:1.0:1787829948.834251:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 211 00000100:00100000:1.0:1787829948.834274:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f313840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+59:11637:x1874675275753088:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:1.0:1787829948.834303:0:10044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829948.834334:0:10044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d869c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8abf expref: -99 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.834429:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d86a3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.834449:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d86a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.834464:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d86a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.834483:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d86aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.834491:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d86aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.834498:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d86aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.834645:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d86b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.834655:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d86b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.834663:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d86b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787829948.834724:0:10044:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787829948.834729:0:10044:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787829948.834755:0:10044:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d86b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.834770:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d86b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.834779:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d86a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.834786:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d86a3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.834794:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d86a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.834814:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feef200 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829948.834819:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d86a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.834828:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d86a3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.835449:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:1.0:1787829948.835454:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829948.835460:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d86a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.835468:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d86a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.835505:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d86aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.835512:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d86aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.835518:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d86aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.835524:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feeee00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829948.835527:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d86aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.835534:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d86aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.835542:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e9b507a7600) 00010000:00010000:1.0:1787829948.835544:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829948.835548:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d86aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.835554:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d86aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.835599:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee400/0xc03b4d103c0d869c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8abf expref: 61 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.835615:0:10044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d86b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8abf expref: 60 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.835636:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:1.0:1787829948.835638:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787829948.835642:0:10044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feefa00, rc 0) 00000100:00100000:1.0:1787829948.835738:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f313840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+60:11637:x1874675275753088:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 1474us (2978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829948.835748:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 211 00000100:00100000:1.0:1787829948.841894:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829948.841974:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829948.841984:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275753344 00000100:00100000:2.0:1787829948.841999:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275753344 00000100:00100000:2.0:1787829948.842127:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 212 00000100:00100000:2.0:1787829948.842157:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+60:11637:x1874675275753344:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:2.0:1787829948.842187:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829948.842216:0:7257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d86b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8ac6 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.842382:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d86bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.842402:0:7257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8687 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8ab1 expref: 61 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.842411:0:7257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d86b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8abf expref: 61 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.842421:0:7257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d86bf lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.842471:0:7257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d86b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8abf expref: 61 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.842486:0:7257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d86b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8abf expref: 61 pid: 10044 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829948.842503:0:7257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fec4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7257:1874675284128512:192.168.201.51@tcp:104: 00000100:00100000:0.0:1787829948.842714:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275753472 00000100:00100000:0.0:1787829948.842721:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275753472 00010000:00010000:0.0:1787829948.842766:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d86b1 lrc: 6/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8abf expref: 62 pid: 10044 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.842782:0:7257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8687 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ab1 expref: 62 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.842793:0:7257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8687 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ab1 expref: 62 pid: 7257 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829948.842808:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 82 00000100:00100000:2.0:1787829948.842819:0:7257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fec70c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7257:1874675284128640:192.168.201.51@tcp:104: 00000100:00100000:0.0:1787829948.842828:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b4fae5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+62:2362:x1874675275753472:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787829948.842843:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829948.842850:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d86b1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8abf expref: 62 pid: 10044 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829948.842851:0:7257:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b75d9c180 going to sleep for 11 seconds 00010000:00010000:0.0:1787829948.842869:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d86b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8abf expref: 62 pid: 10044 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.842892:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:0.0:1787829948.842898:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d86bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.842905:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d86bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.842912:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829948.842944:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b4fae5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+62:2362:x1874675275753472:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 119us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829948.842953:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 82 00010000:00010000:2.0:1787829948.848623:0:7257:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.51@tcp) returned -22 from blocking AST (req@00000000d4602660 x1874675284128512) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d86b1 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8abf expref: 61 pid: 10044 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829948.848636:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00010000:00010000:2.0:1787829948.849269:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d86b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8abf expref: 61 pid: 10044 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829948.849297:0:7257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fec4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7257:1874675284128512:192.168.201.51@tcp:104: 00000100:00100000:2.0:1787829948.849322:0:7257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fec70c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7257:1874675284128640:192.168.201.51@tcp:104: 00010000:00010000:2.0:1787829948.849356:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:2.0:1787829948.849365:0:7257:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d86bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.849375:0:7257:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d86bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.849387:0:7257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d86bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829948.849392:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275753600 00000100:00100000:1.0:1787829948.849401:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275753600 00010000:00010000:1.0:1787829948.849452:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8687 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ab1 expref: 61 pid: 7257 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829948.849497:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 83 00000100:00100000:1.0:1787829948.849508:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74e192c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6abf229-545c-43fd-8dee-d9adf582be48+61:2362:x1874675275753600:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787829948.849529:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829948.849536:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8687 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ab1 expref: 61 pid: 7257 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.849550:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8687 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ab1 expref: 61 pid: 7257 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.849575:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f400/0xc03b4d103c0d8687 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ab1 expref: 61 pid: 7257 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.849589:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:1.0:1787829948.849615:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d86bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.849625:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d86bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.849634:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d86bf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.849665:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787829948.849681:0:7257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d86bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.849687:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d86bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787829948.849722:0:7257:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000100:00100000:1.0:1787829948.849738:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74e192c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6abf229-545c-43fd-8dee-d9adf582be48+60:2362:x1874675275753600:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 231us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829948.849746:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 83 00010000:00010000:2.0:1787829948.849976:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d86b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8ac6 expref: 61 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.849994:0:7257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d86bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8ac6 expref: 60 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829948.850001:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:2.0:1787829948.850004:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787829948.850007:0:7257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3ee00, rc 0) 00000100:00100000:2.0:1787829948.850081:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+60:11637:x1874675275753344:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 7927us (8206us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1787829948.850099:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 212 00000100:00100000:1.0:1787829948.853150:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829948.853235:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275753856 00000100:00100000:0.0:1787829948.853245:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275753856 00000100:00100000:0.0:1787829948.853331:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 15 00000100:00100000:0.0:1787829948.853343:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa19680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+60:11637:x1874675275753856:12345-192.168.201.51@tcp:103:lfs.0 00010000:00010000:0.0:1787829948.853365:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829948.853396:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898400/0xc03b4d103c0d861e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a9c expref: 60 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.853436:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:0.0:1787829948.853441:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829948.853534:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa19680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+59:11637:x1874675275753856:12345-192.168.201.51@tcp:103:lfs.0 Request processed in 193us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829948.853542:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 15 00000100:00100000:0.0:1787829948.857618:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829948.857738:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275753984 00000100:00100000:1.0:1787829948.857753:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275753984 00000100:00100000:1.0:1787829948.858472:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 213 00000100:00100000:1.0:1787829948.858490:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74e18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+59:11637:x1874675275753984:12345-192.168.201.51@tcp:58:lfs.0 00010000:00010000:1.0:1787829948.858632:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d86cd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.858654:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d86cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.858668:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d86cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787829948.859313:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1787829948.859458:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74e18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+59:11637:x1874675275753984:12345-192.168.201.51@tcp:58:lfs.0 Request processed in 971us (1853us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829948.859471:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 213 00000100:00100000:0.0:1787829948.862389:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829948.862481:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275754112 00000100:00100000:3.0:1787829948.862496:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275754112 00000100:00100000:3.0:1787829948.862606:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 214 00000100:00100000:3.0:1787829948.862620:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74e1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+59:11637:x1874675275754112:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:3.0:1787829948.862648:0:10044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829948.862696:0:10044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d86d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8acd expref: -99 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.862782:0:10044:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d86cd lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.862795:0:10044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d86d4 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8acd expref: 60 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.862833:0:10044:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d86cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.862857:0:10044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d86d4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8acd expref: 60 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.862874:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:3.0:1787829948.862877:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787829948.862882:0:10044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d86d4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8acd expref: 60 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.862890:0:10044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74899600, rc 0) 00000100:00100000:3.0:1787829948.863148:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74e1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+60:11637:x1874675275754112:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 531us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829948.863157:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 214 00000040:00080000:2.0:1787829948.898566:0:11648:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787829948.898579:0:11648:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787829948.898644:0:11648:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1787829948.898652:0:11648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787829948.898790:0:11648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fec70c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11648:1874675284128768:192.168.201.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787829948.898982:0:11648:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b75d9c900 going to sleep for 11 seconds 00000100:00100000:0.0:1787829948.905975:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829948.906321:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275754240 00000100:00100000:3.0:1787829948.906335:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275754240 00000100:00100000:3.0:1787829948.906404:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 215 00000100:00100000:3.0:1787829948.906416:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74e1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+61:11638:x1874675275754240:12345-192.168.201.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787829948.906460:0:7257:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787829948.906623:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74e1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+61:11638:x1874675275754240:12345-192.168.201.51@tcp:53:lhsmtool_posix.0 Request processed in 209us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829948.906632:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 215 00000100:00100000:2.0:1787829948.910742:0:11648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fec70c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11648:1874675284128768:192.168.201.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787829948.912385:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829948.912491:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275754368 00000100:00100000:3.0:1787829948.912503:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275754368 00000100:00100000:3.0:1787829948.912670:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 216 00000100:00100000:3.0:1787829948.912682:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+60:11638:x1874675275754368:12345-192.168.201.51@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787829948.912776:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d86db lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.912793:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d86db lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.912813:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d86db lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.912829:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d86e2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.912964:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d86e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.912975:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d86e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.913053:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d86e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.913064:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d86e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.913070:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d86e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829948.913140:0:10044:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787829948.913146:0:10044:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787829948.913162:0:10044:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d86e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.913176:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d86db lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.913182:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d86db lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.913190:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d86db lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.913196:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74899a00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829948.913201:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d86db lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.913211:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d86db lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.913226:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e9b45193300) 00010000:00010000:3.0:1787829948.913229:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829948.913235:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d86db lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.913241:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d86db lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.913441:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d86e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.913461:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d86e2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.913468:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d86e2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.913473:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74898000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829948.913476:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d86e2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.913483:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d86e2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.913491:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9e9b478cc700) 00010000:00010000:3.0:1787829948.913494:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829948.913497:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d86e2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.913503:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d86e2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.913630:0:10044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d86e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.913637:0:10044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d86e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.913643:0:10044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d86e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.913648:0:10044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74899800 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829948.913658:0:10044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d86e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.913665:0:10044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d86e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.913674:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:3.0:1787829948.913676:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829948.913679:0:10044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d86e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.913686:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d86e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829948.913860:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+60:11638:x1874675275754368:12345-192.168.201.51@tcp:34:lhsmtool_posix.0 Request processed in 1168us (1473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829948.913871:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 216 00000100:00100000:0.0:1787829948.917945:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829948.918298:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275754624 00000100:00100000:1.0:1787829948.918311:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275754624 00000100:00100000:1.0:1787829948.918388:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 217 00000100:00100000:1.0:1787829948.918400:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74e19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+60:11638:x1874675275754624:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787829948.918428:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829948.918456:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d86f0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8ad4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.918735:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d86f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.918753:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d86f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.918765:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d86f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787829948.918778:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787829948.919132:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d86f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.919143:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d86f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.919151:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d86f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.919157:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feeee00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829948.919162:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d86f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.919194:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d86f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.919210:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:1.0:1787829948.919213:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787829948.919219:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d86f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.919227:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d86f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.919408:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d86f0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8ad4 expref: 62 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.919421:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e9b45193300) 00010000:00010000:1.0:1787829948.919424:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787829948.919428:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d86f0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8ad4 expref: 62 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.919441:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feef400, rc 0) 00000100:00100000:1.0:1787829948.919652:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74e19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+61:11638:x1874675275754624:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 1253us (1720us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1787829948.919662:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 217 00000100:00100000:0.0:1787829948.925653:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829948.925767:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275754752 00000100:00100000:1.0:1787829948.925782:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275754752 00000100:00100000:1.0:1787829948.925947:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 218 00000100:00100000:1.0:1787829948.925971:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+61:11638:x1874675275754752:12345-192.168.201.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787829948.926081:0:5805:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787829948.926227:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+61:11638:x1874675275754752:12345-192.168.201.51@tcp:53:lhsmtool_posix.0 Request processed in 261us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829948.926236:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 218 00000100:00100000:2.0:1787829948.932116:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829948.932200:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275755008 00000100:00100000:3.0:1787829948.932214:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275755008 00000100:00100000:3.0:1787829948.932309:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 219 00000100:00100000:3.0:1787829948.932321:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+61:11638:x1874675275755008:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787829948.932351:0:10044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829948.932355:0:10044:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787829948.932391:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f000/0xc03b4d103c0d8695 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8ab8 expref: 61 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.932414:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:3.0:1787829948.932420:0:10044:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787829948.932440:0:10044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d8705 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8adb expref: -99 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787829948.933677:0:10044:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1787829948.934512:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e800/0xc03b4d103c0d870c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.934823:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e800/0xc03b4d103c0d870c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.934956:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e800/0xc03b4d103c0d870c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.935670:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899800/0xc03b4d103c0d8705 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8adb expref: 63 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.935699:0:10044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e800/0xc03b4d103c0d870c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8adb expref: 62 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.935711:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e9b48f25700) 00010000:00010000:0.0:1787829948.935733:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787829948.935738:0:10044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7fa7e800, rc 0) 00000100:00100000:0.0:1787829948.935850:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+62:11638:x1874675275755008:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 3530us (3748us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1787829948.935861:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 219 00000100:00100000:3.0:1787829948.944400:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829948.944653:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275755264 00000100:00100000:1.0:1787829948.944668:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275755264 00000100:00100000:1.0:1787829948.944747:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 220 00000100:00100000:1.0:1787829948.944759:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f311680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+62:11638:x1874675275755264:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787829948.944864:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829948.944900:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7e800/0xc03b4d103c0d870c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8adb expref: 62 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.944923:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e9b48f25700) 00010000:00010000:1.0:1787829948.944936:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787829948.944965:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d871a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.944982:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d871a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.944994:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d871a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.945010:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d8721 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x94952f01 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.945086:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d8721 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x94952f01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.945115:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d8721 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x94952f01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.945225:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d871a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.945232:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d871a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.945239:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d871a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.945246:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feef400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829948.945779:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d871a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.945791:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d871a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.946071:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:1.0:1787829948.946076:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829948.946082:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d871a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.946090:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef400/0xc03b4d103c0d871a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.946109:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d8721 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x94952f01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.946117:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d8721 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x94952f01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.946139:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d8721 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x94952f01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.946145:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feeee00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787829948.946148:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d8721 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x94952f01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.946155:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d8721 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x94952f01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.946164:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x94952f01 (ffff9e9b507a7600) 00010000:00010000:1.0:1787829948.946167:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787829948.946171:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d8721 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x94952f01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.946177:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d8721 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x94952f01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829948.946686:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f311680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+61:11638:x1874675275755264:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 Request processed in 1921us (2295us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787829948.946698:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 220 00000100:00100000:1.0:1787829948.952276:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829948.952430:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275755392 00000100:00100000:3.0:1787829948.952443:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275755392 00000100:00100000:3.0:1787829948.952523:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 221 00000100:00100000:3.0:1787829948.952535:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+61:11638:x1874675275755392:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787829948.952563:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829948.952595:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d8728 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8ae2 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.952643:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d872f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.952660:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d872f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.952674:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d872f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.952813:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d8728 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8ae2 expref: 63 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.952836:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d872f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8ae2 expref: 62 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.952856:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e9b478cc700) 00010000:00010000:3.0:1787829948.952859:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787829948.952864:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74899a00, rc 0) 00000100:00100000:3.0:1787829948.952945:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+62:11638:x1874675275755392:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 411us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829948.952952:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 221 00000100:00100000:2.0:1787829948.957412:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829948.957493:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275755648 00000100:00100000:0.0:1787829948.957507:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275755648 00000100:00100000:0.0:1787829948.957753:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 222 00000100:00100000:0.0:1787829948.957767:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+62:11638:x1874675275755648:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787829948.959508:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8736 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.959548:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8736 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.959923:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8736 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787829948.960629:0:10044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:0.0:1787829948.960745:0:10044:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4602660 reply state 00000000ed126325 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8736 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829948.960754:0:10044:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787829948.960901:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+64:11638:x1874675275755648:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 Request processed in 3132us (3544us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1787829948.960912:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 222 00010000:00010000:3.0:1787829948.966392:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8736 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.966415:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8736 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.966424:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8736 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.966432:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7fc00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829948.966437:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8736 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.966447:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8736 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.966468:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e9b478cc700) 00010000:00010000:3.0:1787829948.966472:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787829948.966491:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8736 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.966498:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8736 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829948.968323:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829948.968452:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275755776 00000100:00100000:1.0:1787829948.968470:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275755776 00000100:00100000:1.0:1787829948.968561:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 223 00000100:00100000:1.0:1787829948.968574:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+63:11638:x1874675275755776:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787829948.968607:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787829948.968634:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d873d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8ae9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.968735:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d873d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8ae9 expref: 64 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.968754:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d873d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8ae9 expref: 64 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829948.968778:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e9b478cc700) 00010000:00010000:1.0:1787829948.968782:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787829948.968788:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feeee00, rc 0) 00000100:00100000:1.0:1787829948.968875:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+64:11638:x1874675275755776:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 303us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829948.968883:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 223 00000100:00100000:0.0:1787829948.971419:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829948.971609:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275755904 00000100:00100000:1.0:1787829948.971622:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275755904 00000100:00100000:1.0:1787829948.971731:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 62 00000100:00100000:1.0:1787829948.971744:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74e18b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+9:2362:x1874675275755904:12345-192.168.201.51@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787829948.972627:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74e18b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+10:2362:x1874675275755904:12345-192.168.201.51@tcp:2:lhsmtool_posix.0 Request processed in 507us (845us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1787829948.972639:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 62 00000100:00100000:2.0:1787829948.976888:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829948.977082:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275756160 00000100:00100000:0.0:1787829948.977095:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275756160 00000100:00100000:0.0:1787829948.977182:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 60 00000100:00100000:0.0:1787829948.977194:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+64:11638:x1874675275756160:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787829948.978116:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+65:11638:x1874675275756160:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 Request processed in 780us (1098us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1787829948.978130:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 60 00000100:00100000:2.0:1787829948.981880:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829948.982175:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275756416 00000100:00100000:3.0:1787829948.982190:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275756416 00000100:00100000:3.0:1787829948.982393:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 224 00000100:00100000:3.0:1787829948.982406:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+65:11638:x1874675275756416:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787829948.982717:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+65:11638:x1874675275756416:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 Request processed in 313us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829948.982726:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 224 00000100:00100000:3.0:1787829948.988393:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829948.989412:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275756544 00000100:00100000:0.0:1787829948.989427:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275756544 00000100:00100000:0.0:1787829948.989659:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 225 00000100:00100000:0.0:1787829948.989672:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+65:11638:x1874675275756544:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787829948.989702:0:10044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829948.989729:0:10044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d8744 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8af0 expref: -99 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.989842:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d874b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.989867:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d874b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.989882:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d874b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787829948.989930:0:10044:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787829948.989965:0:10044:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d874b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.990007:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f600/0xc03b4d103c0d8744 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8af0 expref: 67 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.990086:0:10044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d874b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8af0 expref: 66 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829948.990095:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e9b478cc700) 00010000:00010000:0.0:1787829948.990098:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787829948.990102:0:10044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7fa7f400, rc 0) 00000100:00100000:0.0:1787829948.990175:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+66:11638:x1874675275756544:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 505us (1931us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829948.990183:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 225 00000100:00100000:2.0:1787829948.993350:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829948.993488:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275756672 00000100:00100000:3.0:1787829948.993499:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275756672 00000100:00100000:3.0:1787829948.993578:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 63 00000100:00100000:3.0:1787829948.993590:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+10:2363:x1874675275756672:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787829948.993613:0:8603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829948.993642:0:8603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5968875/0xc03b4d103c0d8752 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8af7 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787829948.993680:0:8603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a901ebd, blocks: 0x1 00010000:00010000:3.0:1787829948.993706:0:8603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=328s v=(0 0) 00010000:00010000:3.0:1787829948.993711:0:8603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787829948.993723:0:8603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5968875/0xc03b4d103c0d8752 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8af7 expref: 11 pid: 8603 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.993746:0:8603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d5968875/0xc03b4d103c0d8752 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8af7 expref: 11 pid: 8603 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829948.993763:0:8603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74898000, rc 0) 00000100:00100000:3.0:1787829948.993844:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+11:2363:x1874675275756672:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 257us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829948.993853:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 63 00000100:00100000:2.0:1787829948.997121:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829948.998389:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275756928 00000100:00100000:1.0:1787829948.998406:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275756928 00000100:00100000:1.0:1787829948.998493:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 226 00000100:00100000:1.0:1787829948.998506:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+66:11638:x1874675275756928:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787829948.998661:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+66:11638:x1874675275756928:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 Request processed in 157us (1555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829948.998689:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 226 00000100:00100000:3.0:1787829949.001868:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829949.002331:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275757056 00000100:00100000:0.0:1787829949.002345:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275757056 00000100:00100000:0.0:1787829949.002412:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 64 00000100:00100000:0.0:1787829949.002423:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f313c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+11:11638:x1874675275757056:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787829949.002448:0:6650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829949.002472:0:6650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c8f3b7b/0xc03b4d103c0d8759 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8afe expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.002689:0:6650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d5968875/0xc03b4d103c0d8752 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8af7 expref: 12 pid: 8603 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.002700:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787829949.002705:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787829949.002711:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c8f3b7b/0xc03b4d103c0d8759 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8afe expref: 12 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.002781:0:6650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d5968875/0xc03b4d103c0d8752 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8af7 expref: 12 pid: 8603 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.002796:0:6650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d5968875/0xc03b4d103c0d8752 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8af7 expref: 12 pid: 8603 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829949.002825:0:6650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b74e1ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6650:1874675284128896:192.168.201.51@tcp:104: 00000100:00100000:0.0:1787829949.002960:0:6650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4548e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787829949.006644:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829949.006784:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275757184 00000100:00100000:1.0:1787829949.006797:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275757184 00010000:00010000:1.0:1787829949.006861:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d5968875/0xc03b4d103c0d8752 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8af7 expref: 13 pid: 8603 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829949.006916:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 84 00000100:00100000:1.0:1787829949.006928:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74e18780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+13:2362:x1874675275757184:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787829949.006950:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829949.007001:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d5968875/0xc03b4d103c0d8752 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8af7 expref: 13 pid: 8603 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.007051:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d5968875/0xc03b4d103c0d8752 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8af7 expref: 13 pid: 8603 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.007085:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787829949.007090:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787829949.007101:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c8f3b7b/0xc03b4d103c0d8759 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8afe expref: 13 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.007113:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c8f3b7b/0xc03b4d103c0d8759 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8afe expref: 13 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.007161:0:8409:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009c8f3b7b/0xc03b4d103c0d8759 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8afe expref: 13 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829949.007210:0:8409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b6fa1bc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8409:1874675284129024:192.168.201.51@tcp:105: 00000100:00100000:1.0:1787829949.007494:0:8409:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b75ca46c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787829949.007790:0:6650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5968875/0xc03b4d103c0d8752 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8af7 expref: 13 pid: 8603 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829949.007809:0:6650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b74e1ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6650:1874675284128896:192.168.201.51@tcp:104: 00010000:00010000:3.0:1787829949.007849:0:6650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009c8f3b7b/0xc03b4d103c0d8759 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c8afe expref: 12 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.007862:0:6650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7fa7ec00, rc 0) 00000100:00100000:3.0:1787829949.007898:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f313c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+12:11638:x1874675275757056:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 5477us (6053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829949.007909:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 64 00000100:00100000:1.0:1787829949.013683:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829949.013773:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275757312 00000100:00100000:3.0:1787829949.013785:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275757312 00002000:00100000:3.0:1787829949.013958:0:6657:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9e9b6fa1a1c0 x1874675275757312/t0(0) o4->b6abf229-545c-43fd-8dee-d9adf582be48@192.168.201.51@tcp:530/0 lens 504/0 e 0 to 0 dl 1787829960 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787829949.013970:0:6657:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e9b6fa1a1c0 with x1874675275757312 ext(0->12) 00002000:00010000:3.0:1787829949.013986:0:6657:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e9b6fa1a1c0 00000100:00100000:3.0:1787829949.014204:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 6 00000100:00100000:3.0:1787829949.014218:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b6abf229-545c-43fd-8dee-d9adf582be48+12:2363:x1874675275757312:12345-192.168.201.51@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787829949.015198:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b6abf229-545c-43fd-8dee-d9adf582be48+14:2363:x1874675275757312:12345-192.168.201.51@tcp:4:lhsmtool_posix.0 Request processed in 976us (1522us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1787829949.015210:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 6 00002000:00100000:3.0:1787829949.015221:0:6657:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9e9b6fa1a1c0 x1874675275757312/t4294967320(0) o4->b6abf229-545c-43fd-8dee-d9adf582be48@192.168.201.51@tcp:530/0 lens 504/448 e 0 to 0 dl 1787829960 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787829949.015265:0:6657:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e9b6fa1a1c0 with x1874675275757312 ext(0->12) 00002000:00010000:3.0:1787829949.015271:0:6657:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e9b6fa1a1c0 00000100:00100000:2.0:1787829949.015713:0:8409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b6fa1bc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8409:1874675284129024:192.168.201.51@tcp:105: 00010000:00010000:2.0:1787829949.015747:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787829949.015785:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74e18780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+13:2362:x1874675275757184:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 8859us (9158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829949.015795:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 84 00000100:00100000:1.0:1787829949.019470:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829949.020048:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275757440 00000100:00100000:3.0:1787829949.020064:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275757440 00000100:00100000:3.0:1787829949.020141:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 227 00000100:00100000:3.0:1787829949.020153:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+66:11638:x1874675275757440:12345-192.168.201.51@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787829949.058588:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1787829949.058652:0:5827:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1787829949.058708:0:5827:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e9b6fa62e40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1787829949.058714:0:5827:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e9b4f8f3b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e9b6fa62180 00000020:00080000:1.0:1787829949.058718:0:5827:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e9b4f8f3900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e9b7fe48c00 00000004:00080000:1.0:1787829949.058752:0:5827:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787829949.058783:0:5827:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e9b44d209c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1787829949.058786:0:5827:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e9b7f800300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e9b7293c480 00000020:00080000:1.0:1787829949.058788:0:5827:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e9b7f800700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e9b52e25400 00000020:00080000:1.0:1787829949.058836:0:5827:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:1.0:1787829949.059005:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+20:11638:x1874675275757440:12345-192.168.201.51@tcp:44:lhsmtool_posix.0 Request processed in 38848us (39547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829949.059194:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787829949.059218:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b74e1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284129152:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787829949.059299:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829949.059362:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284129152 00000100:00100000:0.0:1787829949.059370:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284129152 00000100:00100000:0.0:1787829949.059432:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787829949.059442:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74e1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3279:x1874675284129152:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787829949.059688:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 227 00000100:00100000:1.0:1787829949.059840:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787829949.059852:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b74cf4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284129280:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787829949.059887:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1787829949.059968:0:8603:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1787829949.060010:0:8603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a901ebc, atime: 0x6a901ebd, ctime: 0x6a901ebc, blocks: 0x1 00000020:00080000:2.0:1787829949.060159:0:5838:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1787829949.060421:0:5838:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:0.0:1787829949.060568:0:8603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af060259/0xc03b4d103c0d8760 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.060590:0:8603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=328s v=(0 0) 00010000:00010000:0.0:1787829949.060596:0:8603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787829949.060605:0:8603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af060259/0xc03b4d103c0d8760 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.060645:0:8603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af060259/0xc03b4d103c0d8760 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.060656:0:8603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af060259/0xc03b4d103c0d8760 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.060663:0:8603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af060259/0xc03b4d103c0d8760 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.060679:0:8603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787829949.061241:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74e1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3279:x1874675284129152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1797us (1939us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787829949.061252:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787829949.061289:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284129280 00000100:00100000:0.0:1787829949.061296:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284129280 00000100:00100000:0.0:1787829949.061335:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787829949.061344:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3278:x1874675284129280:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787829949.061368:0:8603:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1787829949.061393:0:8603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004906520a/0xc03b4d103c0d8767 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.061410:0:8603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aee9f3b5/0xc03b4d103c0d8522 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a5d expref: 12 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.061419:0:8603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787829949.061429:0:8603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787829949.061434:0:8603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004906520a/0xc03b4d103c0d8767 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.061474:0:8603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aee9f3b5/0xc03b4d103c0d8522 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a5d expref: 12 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.061489:0:8603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aee9f3b5/0xc03b4d103c0d8522 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a5d expref: 12 pid: 6650 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829949.061504:0:8603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b74e19e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8603:1874675284129408:192.168.201.51@tcp:104: 00000100:00100000:0.0:1787829949.061595:0:8603:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fa62840 going to sleep for 11 seconds 00000004:00080000:0.0:1787829949.061698:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e9b74e1b0c0/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787829949.061706:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b74e1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284129152:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1787829949.062199:0:11133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787829949.062210:0:11133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af060259/0xc03b4d103c0d8760 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.062234:0:11133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7f600 already unused, calling callback (ffffffffc1651420) 00010000:00010000:1.0:1787829949.062240:0:11133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af060259/0xc03b4d103c0d8760 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.062251:0:11133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af060259/0xc03b4d103c0d8760 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.062284:0:11133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af060259/0xc03b4d103c0d8760 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.062292:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af060259/0xc03b4d103c0d8760 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.062318:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829949.062320:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829949.062321:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829949.066412:0:8603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b74e19e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8603:1874675284129408:192.168.201.51@tcp:104: 00010000:00010000:0.0:1787829949.066453:0:8603:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004906520a/0xc03b4d103c0d8767 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829949.066678:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829949.066717:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829949.066765:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275757568 00000100:00100000:3.0:1787829949.066773:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275757568 00000100:00100000:0.0:1787829949.066822:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275757696 00010000:00010000:3.0:1787829949.066823:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aee9f3b5/0xc03b4d103c0d8522 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a5d expref: 13 pid: 6650 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829949.066826:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275757696 00000100:00100000:0.0:1787829949.066867:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 67 00000100:00100000:3.0:1787829949.066869:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 85 00000100:00100000:3.0:1787829949.066878:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+14:2363:x1874675275757568:12345-192.168.201.51@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787829949.066878:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fef7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+14:2360:x1874675275757696:12345-192.168.201.51@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1787829949.067210:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829949.067218:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aee9f3b5/0xc03b4d103c0d8522 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a5d expref: 14 pid: 6650 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.067233:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aee9f3b5/0xc03b4d103c0d8522 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a5d expref: 14 pid: 6650 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.067275:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aee9f3b5/0xc03b4d103c0d8522 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.51@tcp remote: 0x53172783628c8a5d expref: 14 pid: 6650 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.067294:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787829949.067316:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787829949.067323:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004906520a/0xc03b4d103c0d8767 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.067335:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004906520a/0xc03b4d103c0d8767 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.067372:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787829949.067803:0:8603:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004906520a/0xc03b4d103c0d8767 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.067818:0:8603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004906520a/0xc03b4d103c0d8767 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.067829:0:8603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004906520a/0xc03b4d103c0d8767 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.067850:0:8603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004906520a/0xc03b4d103c0d8767 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.067868:0:8603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787829949.069662:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6abf229-545c-43fd-8dee-d9adf582be48+13:2363:x1874675275757568:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 2771us (2929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829949.069680:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 85 00010000:00010000:1.0:1787829949.069857:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787829949.069868:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004906520a/0xc03b4d103c0d8767 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.069883:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7f200 already unused, calling callback (ffffffffc1651420) 00010000:00010000:1.0:1787829949.069888:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004906520a/0xc03b4d103c0d8767 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.069900:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004906520a/0xc03b4d103c0d8767 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.069924:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004906520a/0xc03b4d103c0d8767 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.069932:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004906520a/0xc03b4d103c0d8767 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.069956:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829949.069958:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829949.069959:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829949.070548:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3278:x1874675284129280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9201us (10656us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1787829949.070569:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:1.0:1787829949.070638:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e9b74cf4f00/2, rc 0, transno 4294967321 00000100:00100000:1.0:1787829949.070655:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b74cf4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284129280:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787829949.098613:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787829949.112503:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:2.0:1787829949.112623:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:2.0:1787829949.112638:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:2.0:1787829949.112648:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000100:00100000:0.0:1787829949.112905:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fef7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+7:2360:x1874675275757696:12345-192.168.201.51@tcp:16:lhsmtool_posix.0 Request processed in 46019us (46219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829949.112920:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 67 00000100:00100000:2.0:1787829949.118606:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829949.118745:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275757952 00000100:00100000:3.0:1787829949.118757:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275757952 00000100:00100000:3.0:1787829949.118922:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 228 00000100:00100000:3.0:1787829949.118934:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+20:11638:x1874675275757952:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787829949.119007:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829949.119078:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d874b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8af0 expref: 20 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.119109:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e9b478cc700) 00010000:00010000:3.0:1787829949.119115:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787829949.119155:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d876e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.119171:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d876e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.119184:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d876e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787829949.119515:0:5806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb26ccac reply state 00000000290f59fc transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d876e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829949.119526:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787829949.119657:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+21:11638:x1874675275757952:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 Request processed in 724us (1065us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1787829949.119665:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 228 00000100:00100000:1.0:1787829949.123347:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829949.123428:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275758080 00000100:00100000:2.0:1787829949.123441:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275758080 00000100:00100000:2.0:1787829949.123514:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 68 00000100:00100000:2.0:1787829949.123526:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+7:2362:x1874675275758080:12345-192.168.201.51@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787829949.123825:0:6650:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787829949.123830:0:6650:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787829949 00002000:00010000:2.0:1787829949.123833:0:6650:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787829949 00002000:00010000:2.0:1787829949.123836:0:6650:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787829949 -> 1787829949 00002000:00010000:2.0:1787829949.123838:0:6650:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787829949.123932:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+8:2362:x1874675275758080:12345-192.168.201.51@tcp:2:lhsmtool_posix.0 Request processed in 408us (597us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787829949.123962:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 68 00010000:00010000:0.0:1787829949.125470:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d876e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.125490:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d876e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.125500:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d876e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.125508:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74898000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829949.125514:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d876e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.125523:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d876e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.125545:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e9b478cc700) 00010000:00010000:0.0:1787829949.125548:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787829949.125554:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d876e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.125561:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898000/0xc03b4d103c0d876e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829949.126496:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829949.126587:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275758336 00000100:00100000:2.0:1787829949.126600:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275758336 00000100:00100000:2.0:1787829949.126666:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 229 00000100:00100000:2.0:1787829949.126677:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+20:11638:x1874675275758336:12345-192.168.201.51@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787829949.126769:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d8775 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.126788:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d872f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8ae2 expref: 20 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.126809:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d8775 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.126862:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d872f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ae2 expref: 20 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.126878:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d872f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ae2 expref: 20 pid: 5805 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829949.126898:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1874675284129536:192.168.201.51@tcp:104: 00000100:00100000:2.0:1787829949.127010:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b75d9c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787829949.136367:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829949.136459:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275758464 00000100:00100000:0.0:1787829949.136472:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275758464 00010000:00010000:0.0:1787829949.136530:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d872f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ae2 expref: 21 pid: 5805 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829949.136592:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 86 00000100:00100000:0.0:1787829949.136604:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f99b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6abf229-545c-43fd-8dee-d9adf582be48+21:2362:x1874675275758464:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787829949.136647:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829949.136655:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d872f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ae2 expref: 21 pid: 5805 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.136671:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d872f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ae2 expref: 21 pid: 5805 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.136702:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e9b478cc700) 00010000:00010000:0.0:1787829949.136709:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d8775 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.136721:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d8775 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.136731:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d8775 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.136757:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829949.136840:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f99b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6abf229-545c-43fd-8dee-d9adf582be48+21:2362:x1874675275758464:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 237us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829949.136849:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 86 00010000:00010000:2.0:1787829949.137078:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899a00/0xc03b4d103c0d872f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ae2 expref: 20 pid: 5805 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829949.137112:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1874675284129536:192.168.201.51@tcp:104: 00010000:00010000:2.0:1787829949.137148:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d8775 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.137160:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d8775 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.137166:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d8775 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.137204:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d8775 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.137212:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d8775 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.137219:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d8775 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.137227:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3ec00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787829949.137232:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d8775 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.137240:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d8775 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.137251:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e9b478cc700) 00010000:00010000:2.0:1787829949.137264:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787829949.137269:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d8775 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.137276:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ec00/0xc03b4d103c0d8775 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829949.137333:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+19:11638:x1874675275758336:12345-192.168.201.51@tcp:55:lhsmtool_posix.0 Request processed in 10658us (10848us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787829949.137343:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 229 00000100:00100000:3.0:1787829949.140824:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829949.140944:0:8603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275758592 00000100:00100000:1.0:1787829949.140957:0:8603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275758592 00000100:00100000:1.0:1787829949.141078:0:8603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 69 00000100:00100000:1.0:1787829949.141241:0:8603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7a4bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+8:2361:x1874675275758592:12345-192.168.201.51@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787829949.141314:0:8603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000001672573/0xc03b4d103c0d877c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.141340:0:8603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009c8f3b7b/0xc03b4d103c0d8759 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c8afe expref: 8 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.141350:0:8603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787829949.141355:0:8603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787829949.141360:0:8603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001672573/0xc03b4d103c0d877c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.141437:0:8603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009c8f3b7b/0xc03b4d103c0d8759 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8afe expref: 8 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.141453:0:8603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009c8f3b7b/0xc03b4d103c0d8759 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8afe expref: 8 pid: 6650 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829949.141486:0:8603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbef0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8603:1874675284129664:192.168.201.51@tcp:104: 00000100:00100000:1.0:1787829949.141585:0:8603:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47e28a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787829949.144919:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829949.145060:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275758720 00000100:00100000:2.0:1787829949.145072:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275758720 00010000:00010000:2.0:1787829949.145131:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009c8f3b7b/0xc03b4d103c0d8759 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8afe expref: 9 pid: 6650 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829949.145182:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 87 00000100:00100000:2.0:1787829949.145193:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+9:2363:x1874675275758720:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787829949.145214:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829949.145244:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009c8f3b7b/0xc03b4d103c0d8759 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8afe expref: 9 pid: 6650 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.145295:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009c8f3b7b/0xc03b4d103c0d8759 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8afe expref: 9 pid: 6650 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.145330:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787829949.145335:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787829949.145342:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001672573/0xc03b4d103c0d877c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.145353:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001672573/0xc03b4d103c0d877c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.145402:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787829949.145466:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+9:2363:x1874675275758720:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 274us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829949.145474:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 87 00010000:00010000:1.0:1787829949.146321:0:8603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c8f3b7b/0xc03b4d103c0d8759 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8afe expref: 8 pid: 6650 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829949.146345:0:8603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbef0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8603:1874675284129664:192.168.201.51@tcp:104: 00010000:00010000:1.0:1787829949.146376:0:8603:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001672573/0xc03b4d103c0d877c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.146389:0:8603:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001672573/0xc03b4d103c0d877c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.146397:0:8603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001672573/0xc03b4d103c0d877c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.146431:0:8603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000001672573/0xc03b4d103c0d877c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.146440:0:8603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001672573/0xc03b4d103c0d877c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.146450:0:8603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001672573/0xc03b4d103c0d877c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.146474:0:8603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feee800 already unused, calling callback (ffffffffc1651420) 00010000:00010000:1.0:1787829949.146480:0:8603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001672573/0xc03b4d103c0d877c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.146491:0:8603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001672573/0xc03b4d103c0d877c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.146508:0:8603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001672573/0xc03b4d103c0d877c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.146517:0:8603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001672573/0xc03b4d103c0d877c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829949.146597:0:8603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7a4bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6abf229-545c-43fd-8dee-d9adf582be48+7:2361:x1874675275758592:12345-192.168.201.51@tcp:1:lhsmtool_posix.0 Request processed in 5509us (5799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829949.146606:0:8603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 69 00000100:00100000:3.0:1787829949.149709:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829949.149824:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275758976 00000100:00100000:1.0:1787829949.149838:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275758976 00000100:00100000:1.0:1787829949.150079:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 230 00000100:00100000:1.0:1787829949.150210:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+19:11638:x1874675275758976:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787829949.150329:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d8783 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.150351:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d8783 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.150387:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d8783 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.150678:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d878a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.150690:0:7257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d873d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8ae9 expref: 20 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.150700:0:7257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d878a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.150744:0:7257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d873d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ae9 expref: 20 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.150761:0:7257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d873d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ae9 expref: 20 pid: 5804 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829949.150780:0:7257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbef0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7257:1874675284129792:192.168.201.51@tcp:104: 00000100:00100000:0.0:1787829949.151854:0:7257:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47e28a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787829949.155618:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829949.155710:0:7257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbef0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7257:1874675284129792:192.168.201.51@tcp:104: 00010000:00010000:0.0:1787829949.155744:0:7257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d878a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829949.155915:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275759104 00000100:00100000:1.0:1787829949.155924:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275759104 00010000:00010000:1.0:1787829949.155982:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d873d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ae9 expref: 21 pid: 5804 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829949.156058:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 88 00000100:00100000:1.0:1787829949.156068:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b4fae4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6abf229-545c-43fd-8dee-d9adf582be48+21:2362:x1874675275759104:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787829949.156097:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829949.156124:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d873d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ae9 expref: 21 pid: 5804 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.156137:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d873d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ae9 expref: 21 pid: 5804 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.156164:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d873d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ae9 expref: 21 pid: 5804 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.156184:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e9b478cc700) 00010000:00010000:1.0:1787829949.156189:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d878a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.156199:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d878a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.156208:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d878a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.156230:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787829949.156355:0:7257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d878a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.156374:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d878a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787829949.156620:0:7257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1787829949.156785:0:7257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1787829949.156960:0:7257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1787829949.157122:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b4fae4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6abf229-545c-43fd-8dee-d9adf582be48+23:2362:x1874675275759104:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 1051us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829949.157134:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 88 00000100:00100000:0.0:1787829949.157271:0:7257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b74e19e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7257:1874675284129920:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787829949.157338:0:7257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829949.157373:0:7257:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fa62b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787829949.157393:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284129920 00000100:00100000:2.0:1787829949.157402:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284129920 00000100:00100000:2.0:1787829949.157455:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787829949.157465:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74e192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7257:x1874675284129920:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787829949.157756:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74e192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7257:x1874675284129920:12345-0@lo:1000:mdt00_003.0 Request processed in 292us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829949.157765:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787829949.157888:0:7257:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:0.0:1787829949.157895:0:7257:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:0.0:1787829949.157922:0:7257:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9e9b74cf4f00 x1874675284129280/t4294967321(4294967321) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787829965 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829949.157936:0:7257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b74e19e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7257:1874675284129920:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787829949.158511:0:7257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1787829949.158596:0:7257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b74e19e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7257:1874675284130048:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787829949.158648:0:7257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829949.158682:0:7257:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fa62cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787829949.158863:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284130048 00000100:00100000:1.0:1787829949.158870:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284130048 00000100:00100000:1.0:1787829949.158909:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787829949.158919:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74e18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7257:x1874675284130048:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787829949.159160:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74e18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7257:x1874675284130048:12345-0@lo:1000:mdt00_003.0 Request processed in 242us (511us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787829949.159180:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787829949.159348:0:7257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b74e19e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7257:1874675284130048:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787829949.159389:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d878a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.159401:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d878a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.159410:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d878a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.159428:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feef000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829949.159433:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d878a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.159442:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d878a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.159463:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e9b478cc700) 00010000:00010000:0.0:1787829949.159466:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787829949.159472:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d878a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.159478:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef000/0xc03b4d103c0d878a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.159515:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d86cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.159522:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d86cd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.159528:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d86cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.159533:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feef200 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829949.159536:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d86cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.159542:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d86cd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.159562:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:0.0:1787829949.159564:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787829949.159572:0:7257:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d86d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8acd expref: 23 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.159584:0:7257:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d86d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8acd expref: 23 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.162266:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d86d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8acd expref: 23 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.162345:0:7257:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d86d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8acd expref: 23 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829949.162365:0:7257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b74e18b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7257:1874675284130176:192.168.201.51@tcp:105: 00000100:00100000:0.0:1787829949.162501:0:7257:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fa62cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787829949.166131:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829949.166267:0:7257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b74e18b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7257:1874675284130176:192.168.201.51@tcp:105: 00010000:00010000:0.0:1787829949.166309:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d86cd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.166323:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d86cd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.166368:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ec00/0xc03b4d103c0d8791 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.166385:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ec00/0xc03b4d103c0d8791 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.166417:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ec00/0xc03b4d103c0d8791 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.166430:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ec00/0xc03b4d103c0d8791 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.166436:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ec00/0xc03b4d103c0d8791 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.166443:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ec00/0xc03b4d103c0d8791 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.166450:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7ec00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829949.166455:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ec00/0xc03b4d103c0d8791 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.166462:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ec00/0xc03b4d103c0d8791 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.166475:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:0.0:1787829949.166478:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787829949.166481:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ec00/0xc03b4d103c0d8791 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.166486:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ec00/0xc03b4d103c0d8791 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.166496:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d8783 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.166500:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d8783 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.166512:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d8783 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.166516:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feee600 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787829949.166519:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d8783 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.166525:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d8783 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.166532:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:0.0:1787829949.166535:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787829949.166537:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d8783 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829949.166543:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee600/0xc03b4d103c0d8783 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829949.166841:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+23:11638:x1874675275758976:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 Request processed in 16750us (17145us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1787829949.166855:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 230 00000020:00080000:0.0:1787829949.166863:0:7257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787829949.167066:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275759232 00000100:00100000:1.0:1787829949.167076:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275759232 00000100:00100000:1.0:1787829949.167122:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 61 00000100:00100000:1.0:1787829949.167132:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+23:11637:x1874675275759232:12345-192.168.201.51@tcp:49:lfs.0 00000100:00100000:1.0:1787829949.167252:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+23:11637:x1874675275759232:12345-192.168.201.51@tcp:49:lfs.0 Request processed in 121us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829949.167270:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 61 00000040:00080000:2.0:1787829949.167461:0:11648:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787829949.167467:0:11648:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787829949.168083:0:11648:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787829949.168095:0:11648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787829949.171382:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829949.171503:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275759488 00000100:00100000:1.0:1787829949.171517:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275759488 00000100:00100000:1.0:1787829949.171590:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 231 00000100:00100000:1.0:1787829949.171600:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+23:11637:x1874675275759488:12345-192.168.201.51@tcp:58:lfs.0 00000040:00080000:1.0:1787829949.172181:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1787829949.172304:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6abf229-545c-43fd-8dee-d9adf582be48+23:11637:x1874675275759488:12345-192.168.201.51@tcp:58:lfs.0 Request processed in 704us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829949.172315:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 231 00000100:00100000:3.0:1787829949.179012:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829949.179501:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275759744 00000100:00100000:1.0:1787829949.179516:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275759744 00000100:00100000:1.0:1787829949.179634:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 62 00000100:00100000:1.0:1787829949.179648:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b50360050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+23:11638:x1874675275759744:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787829949.180559:0:5808:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787829949.180669:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1787829949.180724:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d8798 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.180744:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d8798 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.180767:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d8798 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.180777:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d8798 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.180783:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d8798 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.180791:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d8798 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829949.180830:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787829949.180964:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b50360050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+25:11638:x1874675275759744:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 Request processed in 1315us (1963us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1787829949.180975:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 62 00000020:00080000:1.0:1787829949.180982:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787829949.181668:0:11133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787829949.181679:0:11133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d8798 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.181690:0:11133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feeee00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:2.0:1787829949.181694:0:11133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d8798 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.181704:0:11133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d8798 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.181722:0:11133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e9b507a7500) 00010000:00010000:2.0:1787829949.181735:0:11133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787829949.181742:0:11133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d8798 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.181749:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeee00/0xc03b4d103c0d8798 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.181771:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829949.181773:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829949.181775:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787829949.203264:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829949.203382:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275759872 00000100:00100000:2.0:1787829949.203398:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275759872 00000100:00100000:2.0:1787829949.203492:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 232 00000100:00100000:2.0:1787829949.203505:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+25:11640:x1874675275759872:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:2.0:1787829949.203545:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829949.203576:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d879f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8b05 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.203667:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d87a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.203685:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d87a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.203700:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d87a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.203718:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d87ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.203726:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d87ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.203750:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d87ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.204218:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d87b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.204232:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d86bf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8ac6 expref: 26 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.204242:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d87b4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.204297:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d86bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ac6 expref: 26 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.204313:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d86bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ac6 expref: 26 pid: 7257 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829949.204330:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1874675284130304:192.168.201.51@tcp:104: 00000100:00100000:2.0:1787829949.204448:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b75d9c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787829949.207913:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829949.208122:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ebc780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1874675284130304:192.168.201.51@tcp:104: 00010000:00010000:2.0:1787829949.208158:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d87b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787829949.208245:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275760128 00000100:00100000:0.0:1787829949.208284:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275760128 00000100:00100000:0.0:1787829949.208363:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 63 00000100:00100000:0.0:1787829949.208374:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+27:5599:x1874675275760128:12345-192.168.201.51@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787829949.208695:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+28:5599:x1874675275760128:12345-192.168.201.51@tcp:35:ldlm_bl.0 Request processed in 321us (795us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1787829949.208725:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 63 00000100:00100000:3.0:1787829949.211517:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829949.211685:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275760256 00000100:00100000:2.0:1787829949.211696:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275760256 00010000:00010000:2.0:1787829949.211750:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d86bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ac6 expref: 28 pid: 7257 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787829949.211831:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 89 00000100:00100000:2.0:1787829949.211849:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe7a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+28:2362:x1874675275760256:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787829949.211872:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787829949.211881:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d86bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ac6 expref: 28 pid: 7257 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.211897:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d86bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ac6 expref: 28 pid: 7257 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.211927:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d86bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ac6 expref: 28 pid: 7257 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.211949:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:2.0:1787829949.212198:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d87b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.212212:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d87b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.212221:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d87b4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829949.212309:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787829949.212391:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe7a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6abf229-545c-43fd-8dee-d9adf582be48+27:2362:x1874675275760256:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 549us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829949.212400:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 89 00010000:00010000:3.0:1787829949.216661:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d87b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.216688:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d87b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787829949.216764:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787829949.216769:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787829949.216912:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d87b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.216934:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d87b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.218608:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d87a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.218616:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d87a6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.218624:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d87a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.218631:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3fa00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829949.218636:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d87a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.218644:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d87a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.218665:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:3.0:1787829949.218669:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829949.218675:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d87a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.218682:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fa00/0xc03b4d103c0d87a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.218701:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d87ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.218708:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d87ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.218714:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d87ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.218734:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f800 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829949.218738:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d87ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.218744:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d87ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.218753:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e9b455ceb00) 00010000:00010000:3.0:1787829949.218756:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829949.218759:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d87ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.218765:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f800/0xc03b4d103c0d87ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.218859:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e000/0xc03b4d103c0d879f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b05 expref: 27 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.218878:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d87b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b05 expref: 26 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829949.218892:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:3.0:1787829949.218895:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787829949.218898:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3f600, rc 0) 00000100:00100000:2.0:1787829949.219650:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+26:11640:x1874675275759872:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 16139us (16403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829949.219673:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 232 00010000:00010000:1.0:1787829950.114538:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787829950.178381:0:11648:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787829950.178392:0:11648:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787829950.178424:0:11648:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787829950.178430:0:11648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787829950.179580:0:11648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbede00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11648:1874675284130432:192.168.201.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787829950.179942:0:11648:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b44d20180 going to sleep for 11 seconds 00000100:00100000:3.0:1787829950.185402:0:11648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbede00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11648:1874675284130432:192.168.201.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787829950.189262:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829950.189613:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275760384 00000100:00100000:0.0:1787829950.189627:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275760384 00000100:00100000:0.0:1787829950.189727:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 233 00000100:00100000:0.0:1787829950.189742:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+26:11652:x1874675275760384:12345-192.168.201.51@tcp:53:lhsmtool_posix.0 00000100:00080000:1.0:1787829950.189870:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:0.0:1787829950.189981:0:7257:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787829950.190177:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+26:11652:x1874675275760384:12345-192.168.201.51@tcp:53:lhsmtool_posix.0 Request processed in 438us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829950.190186:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 233 00000100:00100000:1.0:1787829950.195229:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829950.195346:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275760640 00000100:00100000:0.0:1787829950.195359:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275760640 00000100:00100000:0.0:1787829950.195479:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 234 00000100:00100000:0.0:1787829950.195493:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+26:11652:x1874675275760640:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787829950.195521:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829950.195547:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ec00/0xc03b4d103c0d87bb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8b0c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829950.195679:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d87c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829950.195698:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d87c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829950.195714:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d87c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787829950.195742:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787829950.196524:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ec00/0xc03b4d103c0d87bb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b0c expref: 29 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829950.196549:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d87c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b0c expref: 28 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829950.196560:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:0.0:1787829950.196563:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787829950.196567:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7fa7fa00, rc 0) 00000100:00100000:0.0:1787829950.196654:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+28:11652:x1874675275760640:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 1150us (1426us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1787829950.196664:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 234 00000100:00100000:3.0:1787829950.200350:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829950.200397:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275760768 00000100:00100000:3.0:1787829950.200408:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275760768 00000100:00100000:3.0:1787829950.200480:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 16 00000100:00100000:3.0:1787829950.200491:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+28:2363:x1874675275760768:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787829950.200512:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829950.200544:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fa00/0xc03b4d103c0d87c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b0c expref: 28 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829950.200568:0:8409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:3.0:1787829950.200573:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787829950.200631:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b6abf229-545c-43fd-8dee-d9adf582be48+27:2363:x1874675275760768:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 141us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829950.200638:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 16 00000100:00100000:3.0:1787829950.201296:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829950.201327:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275761024 00000100:00100000:3.0:1787829950.201333:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275761024 00000100:00100000:3.0:1787829950.201368:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 235 00000100:00100000:3.0:1787829950.201375:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+27:11652:x1874675275761024:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787829950.201461:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d87d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829950.201480:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d87d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829950.201491:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d87d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829950.201743:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d87d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829950.201753:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d87d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829950.201759:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d87d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829950.201766:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74899000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829950.201771:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d87d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829950.201795:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d87d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829950.201816:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:3.0:1787829950.201820:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787829950.201825:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d87d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829950.201831:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d87d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829950.204391:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+28:11652:x1874675275761024:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 Request processed in 2999us (3080us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1787829950.204409:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 235 00000040:00080000:3.0:1787829950.204639:0:11648:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787829950.204644:0:11648:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787829950.206525:0:11648:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787829950.206552:0:11648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787829950.209245:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829950.212738:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275761280 00000100:00100000:2.0:1787829950.212759:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275761280 00000100:00100000:2.0:1787829950.212949:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 64 00000100:00100000:2.0:1787829950.212973:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74e18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+28:11652:x1874675275761280:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787829950.213336:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74e18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+29:11652:x1874675275761280:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 Request processed in 365us (4114us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1787829950.213345:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 64 00000100:00100000:3.0:1787829950.239496:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829950.239585:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275761536 00000100:00100000:2.0:1787829950.239598:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275761536 00000100:00100000:2.0:1787829950.239695:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 80 00000100:00100000:2.0:1787829950.239709:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+7:2363:x1874675275761536:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829950.239806:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+7:2363:x1874675275761536:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 100us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829950.239816:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 80 00000100:00080000:3.0:1787829950.240258:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787829950.245671:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829950.245723:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829950.245806:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829950.245839:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275761664 00000100:00100000:0.0:1787829950.245851:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275761664 00000100:00100000:0.0:1787829950.245925:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 81 00000100:00100000:0.0:1787829950.245936:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74e19680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+7:2362:x1874675275761664:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787829950.246049:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74e19680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+7:2362:x1874675275761664:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 115us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829950.246058:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 81 00000100:00080000:1.0:1787829950.246101:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787829950.246117:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275761792 00000100:00100000:1.0:1787829950.246121:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275761792 00000100:00100000:3.0:1787829950.246129:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275761408 00000100:00100000:3.0:1787829950.246133:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275761408 00000100:00080000:1.0:1787829950.246140:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787829950.246165:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 298 00000100:00100000:1.0:1787829950.246170:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 161 00000100:00100000:3.0:1787829950.246173:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2362:x1874675275761408:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829950.246177:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74e1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:902200d4-578b-4474-a651-ffe6603128fa+5:2363:x1874675275761792:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829950.246202:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2362:x1874675275761408:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 31us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829950.246208:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 298 00000100:00100000:1.0:1787829950.246225:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74e1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:902200d4-578b-4474-a651-ffe6603128fa+5:2363:x1874675275761792:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 48us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829950.246231:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 161 00010000:00010000:3.0:1787829951.138191:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787829951.411650:0:12523:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787829951.411668:0:12523:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787829951.411743:0:12523:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787829951.411753:0:12523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1787829951.417072:0:7602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1787829951.417095:0:7602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1787829951.646359:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829951.647233:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275762048 00000100:00100000:0.0:1787829951.647251:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275762048 00000100:00100000:0.0:1787829951.647340:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 236 00000100:00100000:0.0:1787829951.647353:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+29:11665:x1874675275762048:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:0.0:1787829951.647409:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787829951.647439:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ec00/0xc03b4d103c0d87d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8b13 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829951.647575:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d87de lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829951.647593:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d87de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829951.647606:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d87de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787829951.647618:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787829951.647792:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7ec00/0xc03b4d103c0d87d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b13 expref: 32 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829951.648572:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d87de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b13 expref: 31 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829951.648582:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:0.0:1787829951.648586:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787829951.648590:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7fa7f400, rc 0) 00000100:00100000:0.0:1787829951.648683:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+31:11665:x1874675275762048:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 1332us (3942us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1787829951.648693:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 236 00000100:00100000:1.0:1787829951.653519:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829951.653637:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275762176 00000100:00100000:3.0:1787829951.653652:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275762176 00000100:00100000:3.0:1787829951.653773:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 237 00000100:00100000:3.0:1787829951.653787:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+31:11665:x1874675275762176:12345-192.168.201.51@tcp:54:lfs.0 00010000:00010000:3.0:1787829951.653902:0:7257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d87ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829951.653924:0:7257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d87ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829951.653939:0:7257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d87ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829951.653977:0:7257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d87ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829951.653985:0:7257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d87ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829951.654047:0:7257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d87ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829951.654056:0:7257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74899000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787829951.654061:0:7257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d87ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829951.654070:0:7257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d87ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829951.654085:0:7257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:3.0:1787829951.654089:0:7257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787829951.654094:0:7257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d87ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829951.654102:0:7257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899000/0xc03b4d103c0d87ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829951.654195:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+31:11665:x1874675275762176:12345-192.168.201.51@tcp:54:lfs.0 Request processed in 410us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829951.654204:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 237 00000100:00100000:2.0:1787829951.753060:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829951.753932:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275762304 00000100:00100000:3.0:1787829951.753948:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275762304 00000100:00100000:3.0:1787829951.754084:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 70 00000100:00100000:3.0:1787829951.754097:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+7:2362:x1874675275762304:12345-192.168.201.51@tcp:101:cat.0 00010000:00010000:3.0:1787829951.754120:0:6650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787829951.754146:0:6650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001387dc84/0xc03b4d103c0d87f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8b1a expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787829951.754206:0:6650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a901ebd, atime: 0x6a901ebd, ctime: 0x6a901ebd, blocks: 0xb 00010000:00010000:3.0:1787829951.754245:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=331s v=(0 0) 00010000:00010000:3.0:1787829951.754249:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787829951.754260:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001387dc84/0xc03b4d103c0d87f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b1a expref: 8 pid: 6650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829951.754281:0:6650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001387dc84/0xc03b4d103c0d87f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b1a expref: 8 pid: 6650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829951.754298:0:6650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74899000, rc 0) 00000100:00100000:3.0:1787829951.754378:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+8:2362:x1874675275762304:12345-192.168.201.51@tcp:101:cat.0 Request processed in 283us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829951.754386:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 70 00000100:00100000:2.0:1787829951.764748:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829951.765301:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275762432 00000100:00100000:3.0:1787829951.765316:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275762432 00002000:00100000:3.0:1787829951.765390:0:6655:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9e9b7f4c12c0 x1874675275762432/t0(0) o3->b6abf229-545c-43fd-8dee-d9adf582be48@192.168.201.51@tcp:532/0 lens 488/0 e 0 to 0 dl 1787829962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787829951.765404:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e9b7f4c12c0 with x1874675275762432 ext(0->4095) 00002000:00010000:3.0:1787829951.765412:0:6655:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e9b7f4c12c0 00000100:00100000:3.0:1787829951.765454:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 7 00000100:00100000:3.0:1787829951.765466:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b6abf229-545c-43fd-8dee-d9adf582be48+8:2361:x1874675275762432:12345-192.168.201.51@tcp:3:cat.0 00000100:00100000:3.0:1787829951.766083:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b6abf229-545c-43fd-8dee-d9adf582be48+8:2361:x1874675275762432:12345-192.168.201.51@tcp:3:cat.0 Request processed in 615us (1348us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787829951.766117:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 7 00002000:00100000:3.0:1787829951.766128:0:6655:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9e9b7f4c12c0 x1874675275762432/t0(0) o3->b6abf229-545c-43fd-8dee-d9adf582be48@192.168.201.51@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787829962 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787829951.766138:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e9b7f4c12c0 with x1874675275762432 ext(0->4095) 00002000:00010000:3.0:1787829951.766144:0:6655:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e9b7f4c12c0 00010000:00010000:2.0:1787829952.162471:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829953.186968:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787829953.314333:0:11648:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787829953.314346:0:11648:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787829953.314417:0:11648:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787829953.314431:0:11648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:2.0:1787829953.381555:0:6746:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 333282534299ns, next at 334282531222ns, rc = 0 00000100:00100000:2.0:1787829953.381604:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284130560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787829953.381694:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829953.381801:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284130560 00000100:00100000:2.0:1787829953.381810:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284130560 00000100:00100000:2.0:1787829953.381880:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787829953.381910:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1874675284130560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787829953.381954:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787829953.382006:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1874675284130560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829953.382040:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1787829953.382064:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787829953.382112:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284130560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787829953.384346:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284130816:0@lo:400:kworker.0 00000100:00100000:1.0:1787829953.384611:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829953.384660:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787829953.384668:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284130944:0@lo:400:kworker.0 00000100:00100000:1.0:1787829953.384696:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829953.384744:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284130816 00000100:00100000:1.0:1787829953.384752:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284130816 00000100:00100000:1.0:1787829953.384806:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284130944 00000100:00100000:1.0:1787829953.384809:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284130944 00000100:00100000:1.0:1787829953.384845:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787829953.384855:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284130816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829953.384912:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284130816:12345-0@lo:400:kworker.0 Request processed in 58us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829953.384920:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787829953.384939:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787829953.384945:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284130944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829953.384983:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284130944:12345-0@lo:400:kworker.0 Request processed in 38us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829953.384989:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787829953.385067:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284130944:0@lo:400:kworker.0 00000100:00100000:1.0:1787829953.385078:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284130816:0@lo:400:kworker.0 00000100:00100000:1.0:1787829953.385106:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3281:1874675284130688:0@lo:400:kworker.0 00000100:00100000:1.0:1787829953.385141:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829953.385168:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbefc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284131200:0@lo:400:kworker.0 00000100:00100000:1.0:1787829953.385208:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829953.385682:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787829953.385692:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1874675284131072:0@lo:400:kworker.0 00000100:00100000:1.0:1787829953.385724:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787829953.385750:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787829953.387014:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284131200 00000100:00100000:3.0:1787829953.387043:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284131200 00000100:00100000:3.0:1787829953.387129:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787829953.387143:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284131200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829953.387262:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284131200:12345-0@lo:400:kworker.0 Request processed in 122us (2052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829953.387271:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787829953.387299:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284131072 00000100:00100000:3.0:1787829953.387303:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284131072 00000100:00100000:3.0:1787829953.387352:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787829953.387359:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874675284131072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829953.387394:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874675284131072:12345-0@lo:400:kworker.0 Request processed in 36us (1670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829953.387400:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787829953.387566:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1874675284131072:0@lo:400:kworker.0 00000100:00100000:3.0:1787829953.387581:0:3281:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1787829953.387587:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e9b7f998000, transno 4294967307 00000004:00080000:3.0:1787829953.387603:0:3281:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1787829953.387630:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e9b74e1b0c0, transno 4294967310 00000100:00100000:3.0:1787829953.387636:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbefc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284131200:0@lo:400:kworker.0 00000100:00080000:2.0:1787829953.389670:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787829953.389684:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787829953.390688:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284130688 00000100:00100000:0.0:1787829953.390706:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284130688 00000100:00100000:0.0:1787829953.390787:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1787829953.390798:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3281:x1874675284130688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829953.390994:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3281:x1874675284130688:12345-0@lo:400:kworker.0 Request processed in 197us (5851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829953.391002:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1787829953.393082:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3281:1874675284130688:0@lo:400:kworker.0 00000100:00100000:3.0:1787829953.890509:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284131328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787829953.890610:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829953.890974:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284131328 00000100:00100000:2.0:1787829953.890985:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284131328 00000100:00100000:2.0:1787829953.891077:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787829953.891090:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284131328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787829953.891139:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787829953.891214:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284131328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829953.891222:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787829953.891479:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284131328:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787829954.210281:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787829954.473580:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1787829954.473607:0:5827:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e9b587bac00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1787829954.473614:0:5827:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e9b51a4b200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e9b587ba240 00000020:00080000:1.0:1787829954.473617:0:5827:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e9b51a4b300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e9b7f3ff000 00000020:00080000:1.0:1787829954.473646:0:5838:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:1.0:1787829954.473897:0:5838:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000004:00080000:1.0:1787829954.473937:0:5827:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:1.0:1787829954.473957:0:5827:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000100:00100000:1.0:1787829954.474085:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbeda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284131456:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787829954.474190:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829954.474294:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284131456 00000100:00100000:1.0:1787829954.474320:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284131456 00000100:00100000:1.0:1787829954.474381:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787829954.474392:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3279:x1874675284131456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787829954.474628:0:6650:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787829954.474633:0:6650:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787829949 -> 1787829949 00002000:00010000:1.0:1787829954.474636:0:6650:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1787829949 -> 1787829949 00002000:00010000:1.0:1787829954.474638:0:6650:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787829949 -> 1787829949 00002000:00010000:1.0:1787829954.474641:0:6650:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787829954.474693:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3279:x1874675284131456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 302us (503us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1787829954.474701:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000004:00080000:1.0:1787829954.474769:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e9b7fbeda40/2, rc 0, transno 4294967324 00000100:00100000:1.0:1787829954.474777:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbeda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284131456:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1787829954.490152:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1787829954.490284:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00010000:00010000:1.0:1787829955.245691:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787829955.365796:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829955.365845:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829955.365880:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829955.365903:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829955.365933:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829955.366426:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275762688 00000100:00100000:3.0:1787829955.366440:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275762688 00000100:00100000:3.0:1787829955.366514:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275763072 00000100:00100000:3.0:1787829955.366517:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275763072 00000100:00100000:3.0:1787829955.366546:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 165 00000100:00100000:3.0:1787829955.366558:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+18:2362:x1874675275762688:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829955.366661:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6abf229-545c-43fd-8dee-d9adf582be48+18:2362:x1874675275762688:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 106us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829955.366668:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 165 00000100:00100000:3.0:1787829955.366686:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 166 00000100:00100000:3.0:1787829955.366692:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:902200d4-578b-4474-a651-ffe6603128fa+5:2362:x1874675275763072:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829955.366715:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:902200d4-578b-4474-a651-ffe6603128fa+5:2362:x1874675275763072:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 23us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829955.366721:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 166 00000100:00100000:3.0:1787829955.366751:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275762944 00000100:00100000:3.0:1787829955.366754:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275762944 00000100:00100000:3.0:1787829955.366782:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275762816 00000100:00100000:3.0:1787829955.366784:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275762816 00000100:00100000:3.0:1787829955.366804:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 83 00000100:00100000:3.0:1787829955.366810:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+5:2362:x1874675275762944:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829955.366838:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+5:2362:x1874675275762944:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 29us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829955.366845:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 83 00000100:00100000:3.0:1787829955.366855:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 84 00000100:00100000:3.0:1787829955.366861:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+7:2362:x1874675275762816:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829955.366889:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6abf229-545c-43fd-8dee-d9adf582be48+7:2362:x1874675275762816:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 28us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829955.366895:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 84 00000100:00100000:3.0:1787829955.366916:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275762560 00000100:00100000:3.0:1787829955.366919:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275762560 00000100:00100000:3.0:1787829955.366945:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 300 00000100:00100000:3.0:1787829955.366951:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2362:x1874675275762560:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829955.366975:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2362:x1874675275762560:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 25us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829955.366981:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 300 00000100:00080000:3.0:1787829955.367047:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787829955.367052:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787829955.367055:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787829956.258482:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787829956.925981:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829956.926169:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275763200 00000100:00100000:1.0:1787829956.926182:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275763200 00000100:00100000:1.0:1787829956.926268:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 238 00000100:00100000:1.0:1787829956.926280:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+18:11325:x1874675275763200:12345-192.168.201.51@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787829956.926426:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6abf229-545c-43fd-8dee-d9adf582be48+18:11325:x1874675275763200:12345-192.168.201.51@tcp:60:lhsmtool_posix.0 Request processed in 148us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829956.926435:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 238 00000100:00100000:2.0:1787829956.942761:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829956.942945:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275763456 00000100:00100000:3.0:1787829956.942963:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275763456 00000100:00100000:3.0:1787829956.943064:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 65 00000100:00100000:3.0:1787829956.943076:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+18:11325:x1874675275763456:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787829956.943986:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+19:11325:x1874675275763456:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 Request processed in 872us (1195us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1787829956.944000:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 65 00000100:00100000:3.0:1787829957.097755:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829957.097956:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275763584 00000100:00100000:1.0:1787829957.097970:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275763584 00000100:00100000:2.0:1787829957.098361:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 239 00000100:00100000:2.0:1787829957.098376:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:902200d4-578b-4474-a651-ffe6603128fa+5:12118:x1874675275763584:12345-192.168.201.51@tcp:101:lsof.0 00010000:00010000:2.0:1787829957.098403:0:10044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787829957.098427:0:10044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d87fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8b21 expref: -99 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829957.098531:0:10044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d8801 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829957.098546:0:10044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d8801 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829957.098556:0:10044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d8801 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787829957.098805:0:10044:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787829957.098809:0:10044:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787829957.098881:0:10044:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d8801 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829957.098908:0:10044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e800/0xc03b4d103c0d87fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b21 expref: 7 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829957.098926:0:10044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d8801 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b21 expref: 6 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829957.098933:0:10044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b48f25c00) 00010000:00010000:2.0:1787829957.098936:0:10044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787829957.098941:0:10044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3ee00, rc 0) 00000100:00100000:2.0:1787829957.099070:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:902200d4-578b-4474-a651-ffe6603128fa+6:12118:x1874675275763584:12345-192.168.201.51@tcp:101:lsof.0 Request processed in 699us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829957.099080:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 239 00000100:00080000:3.0:1787829957.099266:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787829957.282518:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829958.310867:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829958.500783:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874675284131840:0@lo:400:kworker.0 00000100:00100000:3.0:1787829958.500813:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284131584:0@lo:400:kworker.0 00000100:00100000:3.0:1787829958.501102:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829958.501289:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284131584 00000100:00100000:3.0:1787829958.501299:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284131584 00000100:00100000:3.0:1787829958.501357:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1787829958.501366:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3280:x1874675284131584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829958.501419:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3280:x1874675284131584:12345-0@lo:400:kworker.0 Request processed in 54us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829958.501426:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1787829958.501476:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284131584:0@lo:400:kworker.0 00000100:00100000:2.0:1787829958.501605:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1874675284131968:0@lo:400:kworker.0 00000100:00100000:2.0:1787829958.501638:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829958.502479:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284131968 00000100:00100000:3.0:1787829958.502487:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284131968 00000100:00100000:3.0:1787829958.502534:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787829958.502543:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1874675284131968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787829958.502892:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829958.502964:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1874675284132224:0@lo:400:kworker.0 00000100:00100000:0.0:1787829958.503075:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829958.503120:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787829958.503127:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284132096:0@lo:400:kworker.0 00000100:00100000:0.0:1787829958.503180:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829958.503233:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284131840 00000100:00100000:0.0:1787829958.503240:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284131840 00000100:00100000:1.0:1787829958.503242:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284132224 00000100:00100000:1.0:1787829958.503246:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284132224 00000100:00100000:1.0:1787829958.503301:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787829958.503309:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1874675284131968:12345-0@lo:400:kworker.0 Request processed in 751us (1652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829958.503332:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74e1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874675284131840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829958.503398:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74e1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874675284131840:12345-0@lo:400:kworker.0 Request processed in 70us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829958.503457:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1874675284131968:0@lo:400:kworker.0 00000100:00100000:2.0:1787829958.503482:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787829958.503491:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbeed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284131712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787829958.503539:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829958.503568:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f4c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284132352:0@lo:400:kworker.0 00000100:00100000:2.0:1787829958.503590:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829958.503596:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787829958.503612:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b47a7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874675284132224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829958.503640:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284131712 00000100:00100000:2.0:1787829958.503646:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284131712 00000100:00100000:2.0:1787829958.503685:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787829958.503693:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1874675284131712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787829958.503729:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787829958.503740:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b47a7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874675284132224:12345-0@lo:400:kworker.0 Request processed in 131us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829958.503750:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787829958.503787:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1874675284131712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829958.503799:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787829958.503815:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1874675284132224:0@lo:400:kworker.0 00000100:00100000:0.0:1787829958.503834:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874675284131840:0@lo:400:kworker.0 00000100:00100000:2.0:1787829958.503851:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:2.0:1787829958.503858:0:3279:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e9b74cf4f00, transno 4294967321 00000004:00080000:2.0:1787829958.503876:0:3279:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:2.0:1787829958.503907:0:3279:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9e9b7fbeda40 x1874675284131456/t4294967324(4294967324) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787829970 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787829958.503909:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787829958.503918:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787829958.503935:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbeed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284131712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787829958.503990:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284132096 00000100:00100000:2.0:1787829958.503994:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284132096 00000100:00100000:2.0:1787829958.504062:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284132352 00000100:00100000:2.0:1787829958.504066:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284132352 00000100:00100000:2.0:1787829958.504117:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787829958.504125:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1874675284132096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829958.504189:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1874675284132096:12345-0@lo:400:kworker.0 Request processed in 65us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829958.504195:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787829958.504207:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787829958.504214:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284132352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829958.504252:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284132352:12345-0@lo:400:kworker.0 Request processed in 39us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829958.504258:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787829958.504288:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284132352:0@lo:400:kworker.0 00000100:00100000:2.0:1787829958.504321:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f4c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284132096:0@lo:400:kworker.0 00000100:00080000:0.0:1787829958.504541:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787829958.504572:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787829958.509227:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787829959.014314:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f328f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284132480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787829959.014434:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829959.014525:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284132480 00000100:00100000:2.0:1787829959.014534:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284132480 00000100:00100000:2.0:1787829959.014604:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787829959.014615:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284132480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787829959.014668:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787829959.014727:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284132480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829959.014735:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787829959.014848:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f328f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284132480:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787829959.332503:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787829959.627815:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000020:00080000:0.0:1787829959.628629:0:5827:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:0.0:1787829959.628653:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1787829959.628700:0:5838:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1787829959.628723:0:5838:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:02000400:3.0:1787829959.797434:0:12732:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 07:25:58 (1787829958) 00010000:00010000:3.0:1787829960.355575:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829960.493290:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829960.493386:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829960.493445:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829960.493474:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829960.493506:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829960.493692:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275764096 00000100:00100000:2.0:1787829960.493714:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275764096 00000100:00100000:2.0:1787829960.493796:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275763968 00000100:00100000:2.0:1787829960.493801:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275763968 00000100:00100000:2.0:1787829960.493831:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 87 00000100:00100000:2.0:1787829960.493868:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+5:2363:x1874675275764096:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829960.493967:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+5:2363:x1874675275764096:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 104us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829960.493975:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 87 00000100:00100000:2.0:1787829960.493994:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 88 00000100:00100000:2.0:1787829960.494000:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+7:2363:x1874675275763968:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829960.494080:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+7:2363:x1874675275763968:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 80us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829960.494087:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 88 00000100:00100000:2.0:1787829960.494112:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275763712 00000100:00100000:2.0:1787829960.494116:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275763712 00000100:00100000:2.0:1787829960.494147:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 302 00000100:00100000:2.0:1787829960.494155:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2363:x1874675275763712:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829960.494184:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2363:x1874675275763712:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 31us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829960.494192:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 302 00000100:00080000:2.0:1787829960.494416:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787829960.494422:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787829960.506192:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275763840 00000100:00100000:1.0:1787829960.506212:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275763840 00000100:00100000:2.0:1787829960.506672:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275764224 00000100:00100000:2.0:1787829960.506678:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275764224 00000100:00100000:1.0:1787829960.506739:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 170 00000100:00100000:1.0:1787829960.506753:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+18:2363:x1874675275763840:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787829960.506881:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6abf229-545c-43fd-8dee-d9adf582be48+18:2363:x1874675275763840:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 132us (13606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829960.506889:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 170 00000100:00080000:0.0:1787829960.509376:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787829960.509825:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 171 00000100:00100000:2.0:1787829960.509844:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7489f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:902200d4-578b-4474-a651-ffe6603128fa+6:2363:x1874675275764224:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829960.509965:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7489f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:902200d4-578b-4474-a651-ffe6603128fa+6:2363:x1874675275764224:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 128us (16458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829960.509974:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 171 00010000:00010000:2.0:1787829961.378269:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829962.402291:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829963.426273:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787829963.555001:0:11648:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787829963.555061:0:11648:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787829963.555655:0:11648:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1787829963.555666:0:11648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787829963.619950:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284132608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787829963.620089:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829963.620308:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284132608 00000100:00100000:1.0:1787829963.620318:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284132608 00000100:00100000:1.0:1787829963.620396:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787829963.620407:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284132608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787829963.620452:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787829963.620525:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284132608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829963.620533:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1787829963.620684:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787829963.620718:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1787829963.620725:0:3280:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e9b7fbeda40, transno 4294967324 00000100:00100000:3.0:1787829963.620753:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284132608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787829963.620936:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f383480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1874675284132992:0@lo:400:kworker.0 00000100:00100000:0.0:1787829963.620986:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829963.621063:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787829963.621069:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874675284132864:0@lo:400:kworker.0 00000100:00100000:0.0:1787829963.621094:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829963.621241:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1874675284133120:0@lo:400:kworker.0 00000100:00100000:3.0:1787829963.621269:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829963.621298:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787829963.621303:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fb621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284132736:0@lo:400:kworker.0 00000100:00100000:3.0:1787829963.621340:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829963.621368:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284133248:0@lo:400:kworker.0 00000100:00100000:3.0:1787829963.621395:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829963.621422:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284132736 00000100:00100000:3.0:1787829963.621427:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284132736 00000100:00100000:3.0:1787829963.621463:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1787829963.621471:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3280:x1874675284132736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787829963.621620:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3280:x1874675284132736:12345-0@lo:400:kworker.0 Request processed in 149us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829963.621628:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1787829963.621670:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fb621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284132736:0@lo:400:kworker.0 00000100:00100000:2.0:1787829963.621780:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284133248 00000100:00100000:2.0:1787829963.621785:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284133248 00000100:00100000:2.0:1787829963.621836:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787829963.621843:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284133248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787829963.621886:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284133248:12345-0@lo:400:kworker.0 Request processed in 43us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829963.621893:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787829963.622459:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284132992 00000100:00100000:1.0:1787829963.622467:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284132992 00000100:00100000:1.0:1787829963.622519:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284132864 00000100:00100000:1.0:1787829963.622522:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284132864 00000100:00100000:1.0:1787829963.622540:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284133120 00000100:00100000:1.0:1787829963.622544:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284133120 00000100:00100000:1.0:1787829963.622560:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787829963.622567:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6fa4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1874675284132992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829963.622628:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6fa4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1874675284132992:12345-0@lo:400:kworker.0 Request processed in 61us (1642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829963.622635:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787829963.622647:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787829963.622653:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1874675284132864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829963.622681:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1874675284132864:12345-0@lo:400:kworker.0 Request processed in 29us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829963.622686:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787829963.622697:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787829963.622703:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874675284133120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787829963.622731:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874675284133120:12345-0@lo:400:kworker.0 Request processed in 28us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829963.622736:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787829963.623287:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874675284132864:0@lo:400:kworker.0 00000100:00100000:0.0:1787829963.623303:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f383480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1874675284132992:0@lo:400:kworker.0 00000100:00080000:3.0:1787829963.623728:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787829963.623736:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787829963.623768:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284133248:0@lo:400:kworker.0 00000100:00100000:3.0:1787829963.623783:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1874675284133120:0@lo:400:kworker.0 00000100:00100000:1.0:1787829964.130727:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f328f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284133376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787829964.130835:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829964.131295:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284133376 00000100:00100000:3.0:1787829964.131307:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284133376 00000100:00100000:3.0:1787829964.131385:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787829964.131398:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbeda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284133376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787829964.131455:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787829964.133702:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbeda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284133376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2294us (2853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829964.133718:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787829964.133873:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f328f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284133376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787829964.361508:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829964.361841:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275764480 00000100:00100000:2.0:1787829964.361856:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275764480 00000100:00100000:2.0:1787829964.361949:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 66 00000100:00100000:2.0:1787829964.361972:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+18:12339:x1874675275764480:12345-192.168.201.51@tcp:35:umount.0 00000100:00080000:3.0:1787829964.363186:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787829964.364839:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+19:12339:x1874675275764480:12345-192.168.201.51@tcp:35:umount.0 Request processed in 2857us (3330us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1787829964.364857:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 66 00000100:00100000:1.0:1787829964.372733:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829964.382340:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275764736 00000100:00100000:0.0:1787829964.382365:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275764736 00000100:00100000:0.0:1787829964.382473:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 67 00000100:00100000:0.0:1787829964.382487:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbeed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+19:12339:x1874675275764736:12345-192.168.201.51@tcp:35:umount.0 00000100:00100000:0.0:1787829964.388262:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbeed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+20:12339:x1874675275764736:12345-192.168.201.51@tcp:35:umount.0 Request processed in 5761us (15524us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1787829964.388307:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 67 00000100:00100000:1.0:1787829964.400745:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829964.401218:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275764992 00000100:00100000:2.0:1787829964.401233:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275764992 00000100:00100000:2.0:1787829964.401681:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 68 00000100:00100000:2.0:1787829964.401696:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b50363c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+20:12339:x1874675275764992:12345-192.168.201.51@tcp:35:umount.0 00000100:00100000:2.0:1787829964.403704:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b50363c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6abf229-545c-43fd-8dee-d9adf582be48+21:12339:x1874675275764992:12345-192.168.201.51@tcp:35:umount.0 Request processed in 1999us (2963us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1787829964.403720:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 68 00000100:00100000:2.0:1787829964.406781:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829964.407062:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275765248 00000100:00100000:0.0:1787829964.407084:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275765248 00000100:00100000:0.0:1787829964.407274:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 69 00000100:00100000:0.0:1787829964.407287:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f328f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+21:12339:x1874675275765248:12345-192.168.201.51@tcp:35:umount.0 00000100:00100000:0.0:1787829964.408556:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f328f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6abf229-545c-43fd-8dee-d9adf582be48+22:12339:x1874675275765248:12345-192.168.201.51@tcp:35:umount.0 Request processed in 1261us (1780us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1787829964.408570:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 69 00000100:00100000:1.0:1787829964.416607:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829964.416724:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829964.428080:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829964.434663:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275765376 00000100:00100000:2.0:1787829964.434687:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275765376 00000100:00100000:3.0:1787829964.444256:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275765632 00000100:00100000:3.0:1787829964.444281:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275765632 00000100:00100000:3.0:1787829964.444390:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275765504 00000100:00100000:3.0:1787829964.444618:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275765504 00000100:00100000:3.0:1787829964.444878:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 17 00000100:00100000:3.0:1787829964.444891:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbecb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aaccd34-1037-4ac9-aa31-e92ce8889520+15:2363:x1874675275765376:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787829964.445292:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829964.445338:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b4164e800/0xc03b4d103c0d7879 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c86ac expref: 15 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829964.445363:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787829964.445781:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbecb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aaccd34-1037-4ac9-aa31-e92ce8889520+14:2363:x1874675275765376:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 891us (29715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829964.445813:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 17 00000100:00100000:3.0:1787829964.446192:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 18 00000100:00100000:3.0:1787829964.446204:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aaccd34-1037-4ac9-aa31-e92ce8889520+13:2363:x1874675275765632:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787829964.446216:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829964.446231:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b40031200/0xc03b4d103c0d7a8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8777 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829964.446246:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787829964.446287:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aaccd34-1037-4ac9-aa31-e92ce8889520+12:2363:x1874675275765632:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 87us (29563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829964.446295:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 18 00000100:00100000:3.0:1787829964.446312:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 19 00000100:00100000:3.0:1787829964.446330:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbefc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aaccd34-1037-4ac9-aa31-e92ce8889520+11:2363:x1874675275765504:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787829964.446340:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829964.446350:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b596ca200/0xc03b4d103c0d77df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8674 expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829964.446359:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787829964.446376:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbefc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2363:x1874675275765504:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 47us (18324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829964.446383:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 19 00000100:00100000:1.0:1787829964.450306:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829964.451309:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275765760 00000100:00100000:2.0:1787829964.451328:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275765760 00000100:00100000:2.0:1787829964.451442:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 72 00000100:00100000:2.0:1787829964.451455:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+5:2359:x1874675275765760:12345-192.168.201.51@tcp:9:umount.0 00000100:00080000:3.0:1787829964.451472:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:2.0:1787829964.451500:0:6652:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d7b51 00000100:00080000:2.0:1787829964.451525:0:6652:0:(import.c:65:import_set_state_nolock()) ffff9e9b52e32800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787829964.451584:0:6652:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:3.0:1787829964.451606:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787829964.452585:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6abf229-545c-43fd-8dee-d9adf582be48+2:2359:x1874675275765760:12345-192.168.201.51@tcp:9:umount.0 Request processed in 1124us (2285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829964.452598:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 72 00010000:00010000:3.0:1787829964.453203:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829964.463888:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829964.464205:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275766144 00000100:00100000:2.0:1787829964.464220:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275766144 00000100:00100000:2.0:1787829964.464329:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 73 00000100:00100000:2.0:1787829964.464342:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+7:2359:x1874675275766144:12345-192.168.201.51@tcp:9:umount.0 00000020:00000080:2.0:1787829964.464388:0:6650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d7db9 00000020:00010000:2.0:1787829964.464398:0:6650:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e9b43ebe000: total 0 00000100:00080000:2.0:1787829964.464405:0:6650:0:(import.c:65:import_set_state_nolock()) ffff9e9b43eba000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787829964.464466:0:6650:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:3.0:1787829964.465363:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:1.0:1787829964.469500:0:5793:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e9b43ebe000: total 0 00010000:00010000:1.0:1787829964.469580:0:5793:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e9b43ebe000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1787829964.469766:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000324f7c36/0xc03b4d103c0d8155 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c894c expref: 6 pid: 6650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829964.469822:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001387dc84/0xc03b4d103c0d87f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b1a expref: 6 pid: 6650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829964.469842:0:5793:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e9b43ebe000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1787829964.469858:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829964.469861:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829964.469864:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787829964.471860:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6abf229-545c-43fd-8dee-d9adf582be48+2:2359:x1874675275766144:12345-192.168.201.51@tcp:9:umount.0 Request processed in 7503us (7970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829964.471894:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 73 00000100:00100000:3.0:1787829964.491858:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829964.494228:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275767168 00000100:00100000:1.0:1787829964.494252:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275767168 00000100:00100000:1.0:1787829964.494358:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 240 00000100:00100000:1.0:1787829964.494371:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+22:2359:x1874675275767168:12345-192.168.201.51@tcp:39:umount.0 00000020:00000080:1.0:1787829964.494417:0:7257:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d77ed 00000020:00010000:1.0:1787829964.494445:0:7257:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e9b52051800: total 0 00000100:00080000:1.0:1787829964.494451:0:7257:0:(import.c:65:import_set_state_nolock()) ffff9e9b52056000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787829964.494489:0:7257:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:3.0:1787829964.495876:0:11133:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e9b52051800: total 0 00010000:00010000:3.0:1787829964.496265:0:11133:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e9b52051800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1787829964.496391:0:11133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:3.0:1787829964.496397:0:11133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787829964.496410:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b82175800/0xc03b4d103c0d7b27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c87a1 expref: 21 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829964.496442:0:11133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:3.0:1787829964.496445:0:11133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787829964.496451:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74899600/0xc03b4d103c0d86d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8acd expref: 20 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829964.496467:0:11133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:3.0:1787829964.496470:0:11133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787829964.496474:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74898800/0xc03b4d103c0d81d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c896f expref: 19 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829964.496490:0:11133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:3.0:1787829964.496492:0:11133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787829964.496496:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef600/0xc03b4d103c0d8036 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c88ff expref: 18 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829964.496735:0:11133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e9b45193300) 00010000:00010000:3.0:1787829964.496738:0:11133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787829964.496743:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3e200/0xc03b4d103c0d7ad3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c878c expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829964.496799:0:11133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b48f25c00) 00010000:00010000:3.0:1787829964.496802:0:11133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787829964.496807:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7fe00/0xc03b4d103c0d81b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8968 expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829964.496819:0:11133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:3.0:1787829964.496821:0:11133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787829964.496824:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7fa7f400/0xc03b4d103c0d87de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b13 expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829964.496836:0:11133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:3.0:1787829964.496838:0:11133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787829964.496842:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164fc00/0xc03b4d103c0d8116 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8937 expref: 14 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829964.496855:0:11133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e9b478cca00) 00010000:00010000:3.0:1787829964.496857:0:11133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787829964.496860:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164ec00/0xc03b4d103c0d8140 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8945 expref: 13 pid: 7257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829964.496874:0:11133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:3.0:1787829964.496876:0:11133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787829964.496880:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3f600/0xc03b4d103c0d87b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b05 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829964.496895:0:11133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e9b48f25600) 00010000:00010000:3.0:1787829964.496897:0:11133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00000100:00100000:1.0:1787829964.497514:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6abf229-545c-43fd-8dee-d9adf582be48+11:2359:x1874675275767168:12345-192.168.201.51@tcp:39:umount.0 Request processed in 3136us (5661us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1787829964.497529:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 240 00010000:00010000:3.0:1787829964.498266:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3fe00/0xc03b4d103c0d7e14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8873 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829964.500410:0:11133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e9b478cc000) 00010000:00010000:3.0:1787829964.500423:0:11133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787829964.500443:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b4164f600/0xc03b4d103c0d7ab7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8785 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829964.500500:0:11133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e9b478ccf00) 00010000:00010000:3.0:1787829964.500502:0:11133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787829964.500507:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d84b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8a41 expref: 8 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829964.500533:0:11133:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e9b52051800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1787829964.500575:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829964.500578:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787829964.500580:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787829964.736466:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:0.0:1787829964.736489:0:5827:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b6abf229-545c-43fd-8dee-d9adf582be48 00000001:00080000:0.0:1787829964.736496:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1787829964.736663:0:5827:0:(genops.c:885:class_export_put()) final put ffff9e9b52051800/b6abf229-545c-43fd-8dee-d9adf582be48 00000020:00000080:2.0:1787829964.740554:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b52051800/b6abf229-545c-43fd-8dee-d9adf582be48 for lustre-MDT0000 00000020:00000080:3.0:1787829964.740957:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b52056000 for lustre-MDT0000 00000001:00100000:0.0:1787829964.745737:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b6abf229-545c-43fd-8dee-d9adf582be48 00000020:00000080:0.0:1787829964.745753:0:6674:0:(genops.c:885:class_export_put()) final put ffff9e9b43ebe000/b6abf229-545c-43fd-8dee-d9adf582be48 00000020:00000080:3.0:1787829964.745902:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b43ebe000/b6abf229-545c-43fd-8dee-d9adf582be48 for lustre-OST0000 00000020:00000080:3.0:1787829964.745972:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b43eba000 for lustre-OST0000 00010000:00010000:3.0:1787829965.474259:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829965.600216:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829965.600287:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787829965.600946:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275767424 00000100:00100000:2.0:1787829965.600960:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275767424 00000100:00100000:2.0:1787829965.601125:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 175 00000100:00100000:2.0:1787829965.601139:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:902200d4-578b-4474-a651-ffe6603128fa+6:2363:x1874675275767424:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787829965.601254:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:902200d4-578b-4474-a651-ffe6603128fa+6:2363:x1874675275767424:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 118us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829965.601286:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 175 00000100:00080000:0.0:1787829965.602622:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787829965.603164:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275767296 00000100:00100000:3.0:1787829965.603179:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275767296 00000100:00100000:3.0:1787829965.603313:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 304 00000100:00100000:3.0:1787829965.603325:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2363:x1874675275767296:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787829965.603426:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2363:x1874675275767296:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 103us (3137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829965.603434:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 304 00010000:00010000:1.0:1787829966.499829:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829966.596239:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787829966.596301:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829966.596412:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275767552 00000100:00100000:3.0:1787829966.596427:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275767552 00000100:00100000:3.0:1787829966.596503:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275767680 00000100:00100000:3.0:1787829966.596507:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275767680 00000100:00100000:3.0:1787829966.596532:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 20 00000100:00100000:3.0:1787829966.596544:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aaccd34-1037-4ac9-aa31-e92ce8889520+11:2362:x1874675275767552:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787829966.596567:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829966.596594:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b596cb000/0xc03b4d103c0d78bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c86c1 expref: 11 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829966.596628:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787829966.596693:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aaccd34-1037-4ac9-aa31-e92ce8889520+10:2362:x1874675275767552:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 151us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829966.596702:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 20 00000100:00100000:3.0:1787829966.596722:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 21 00000100:00100000:3.0:1787829966.596728:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b4fae4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aaccd34-1037-4ac9-aa31-e92ce8889520+9:2362:x1874675275767680:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787829966.596738:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829966.596748:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b48cdac00/0xc03b4d103c0d78c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c86eb expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829966.596758:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787829966.596778:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b4fae4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aaccd34-1037-4ac9-aa31-e92ce8889520+8:2362:x1874675275767680:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 50us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829966.596792:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 21 00000100:00100000:2.0:1787829966.597643:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829966.597880:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275767808 00000100:00100000:3.0:1787829966.597888:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275767808 00000100:00100000:3.0:1787829966.597940:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 22 00000100:00100000:3.0:1787829966.597958:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f32bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aaccd34-1037-4ac9-aa31-e92ce8889520+8:2361:x1874675275767808:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787829966.597986:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787829966.597999:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b40030e00/0xc03b4d103c0d7a86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8770 expref: 8 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829966.598012:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787829966.598079:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f32bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aaccd34-1037-4ac9-aa31-e92ce8889520+7:2361:x1874675275767808:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 132us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787829966.598088:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 22 00000100:00100000:2.0:1787829966.607631:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787829966.607771:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275768064 00000100:00100000:3.0:1787829966.607786:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275768064 00000100:00100000:3.0:1787829966.607896:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 241 00000100:00100000:3.0:1787829966.607909:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:902200d4-578b-4474-a651-ffe6603128fa+6:2359:x1874675275768064:12345-192.168.201.51@tcp:39:umount.0 00000020:00000080:3.0:1787829966.607975:0:5806:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d78d4 00000020:00010000:3.0:1787829966.607988:0:5806:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e9b74f2e000: total 0 00000100:00080000:3.0:1787829966.607995:0:5806:0:(import.c:65:import_set_state_nolock()) ffff9e9b74f2c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787829966.608061:0:5806:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1787829966.608502:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:902200d4-578b-4474-a651-ffe6603128fa+5:2359:x1874675275768064:12345-192.168.201.51@tcp:39:umount.0 Request processed in 594us (884us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1787829966.608512:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 241 00000020:00010000:1.0:1787829966.608747:0:11133:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e9b74f2e000: total 0 00010000:00010000:1.0:1787829966.608770:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829966.608825:0:11133:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e9b74f2e000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787829966.608869:0:11133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b48f25c00) 00010000:00010000:1.0:1787829966.608873:0:11133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787829966.608884:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b74e3ee00/0xc03b4d103c0d8801 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b21 expref: 4 pid: 10044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829966.608913:0:11133:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e9b74f2e000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787829966.608925:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829966.608927:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829966.608928:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787829966.625944:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787829966.626072:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275768320 00000100:00100000:0.0:1787829966.626086:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275768320 00000100:00100000:0.0:1787829966.626151:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 305 00000100:00100000:0.0:1787829966.626163:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b69cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+7:2359:x1874675275768320:12345-192.168.201.51@tcp:251:umount.0 00000020:00000080:0.0:1787829966.626224:0:5798:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d77ca 00000020:00010000:0.0:1787829966.626233:0:5798:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e9b7f525000: total 0 00000100:00080000:0.0:1787829966.626238:0:5798:0:(import.c:65:import_set_state_nolock()) ffff9e9b7f523800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1787829966.626322:0:5794:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e9b7f525000: total 0 00000100:00100000:0.0:1787829966.626330:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b69cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aaccd34-1037-4ac9-aa31-e92ce8889520+3:2359:x1874675275768320:12345-192.168.201.51@tcp:251:umount.0 Request processed in 169us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829966.626339:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 305 00010000:00010000:1.0:1787829966.626379:0:5794:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e9b7f525000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787829966.626419:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b4164f400/0xc03b4d103c0d7880 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c86b3 expref: 2 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829966.626437:0:5794:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e9b7f525000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787829966.626447:0:5794:0:(genops.c:885:class_export_put()) final put ffff9e9b7f525000/9aaccd34-1037-4ac9-aa31-e92ce8889520 00010000:00010000:1.0:1787829966.626471:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829966.626473:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829966.626475:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787829966.626621:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b7f525000/9aaccd34-1037-4ac9-aa31-e92ce8889520 for MGS 00000020:00000080:0.0:1787829966.626684:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b7f523800 for MGS 00000001:00100000:3.0:1787829966.737004:0:7602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b6abf229-545c-43fd-8dee-d9adf582be48 00000020:00000080:3.0:1787829966.737012:0:7602:0:(genops.c:885:class_export_put()) final put ffff9e9b52e37000/b6abf229-545c-43fd-8dee-d9adf582be48 00000020:00000080:0.0:1787829966.737168:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b52e37000/b6abf229-545c-43fd-8dee-d9adf582be48 for lustre-OST0001 00000020:00000080:0.0:1787829966.737286:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b52e32800 for lustre-OST0001 00010000:00010000:1.0:1787829967.541989:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829968.546227:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787829968.633425:0:12933:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787829968.659409:0:12933:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787829968.659487:0:12933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b596ca800/0xc03b4d103c0d784f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7856 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829968.659514:0:12933:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b596ca800/0xc03b4d103c0d784f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d7856 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829968.659547:0:12933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b596ca800/0xc03b4d103c0d784f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc03b4d103c0d7856 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829968.659556:0:12933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.151@tcp lock: ffff9e9b596ca800/0xc03b4d103c0d784f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc03b4d103c0d7856 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787829968.659583:0:12933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787829968.659590:0:12933:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787829968.659619:0:12933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787829968.659625:0:12933:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787829968.659632:0:12933:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787829968.659665:0:12933:0:(import.c:65:import_set_state_nolock()) ffff9e9b50388000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787829968.659796:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787829968.659805:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b596ca800/0xc03b4d103c0d784f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc03b4d103c0d7856 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.659814:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b596ca800 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:0.0:1787829968.659818:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b596ca800/0xc03b4d103c0d784f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc03b4d103c0d7856 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.659828:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b596ca800/0xc03b4d103c0d784f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc03b4d103c0d7856 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787829968.659836:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b596ca800/0xc03b4d103c0d784f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc03b4d103c0d7856 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787829968.659843:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787829968.659845:0:5794:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787829968.659848:0:5794:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787829968.659881:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b596ca800/0xc03b4d103c0d784f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc03b4d103c0d7856 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.659887:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787829968.659926:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b596ca800/0xc03b4d103c0d784f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc03b4d103c0d7856 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.659934:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b596ca800/0xc03b4d103c0d784f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc03b4d103c0d7856 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.659961:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829968.659963:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829968.659965:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829968.660068:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fa461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1874675284133504:0@lo:39:umount.0 00000100:00100000:1.0:1787829968.660165:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829968.660246:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787829968.660257:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f99b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284133632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787829968.660288:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829968.660331:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284133632 00000100:00100000:1.0:1787829968.660339:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284133632 00000100:00100000:1.0:1787829968.660410:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787829968.660421:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3278:x1874675284133632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787829968.660773:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829968.660796:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b48cdb000/0xc03b4d103c0d7856 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc03b4d103c0d784f expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829968.660815:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829968.660862:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:3278:x1874675284133632:12345-0@lo:103:ldlm_bl.0 Request processed in 442us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829968.660871:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787829968.660933:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f99b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284133632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787829968.661715:0:7257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284133504 00000100:00100000:0.0:1787829968.661726:0:7257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284133504 00000100:00100000:0.0:1787829968.661787:0:7257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787829968.661797:0:7257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1874675284133504:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787829968.661829:0:7257:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d75e7 00000100:00080000:0.0:1787829968.661841:0:7257:0:(import.c:65:import_set_state_nolock()) ffff9e9b50392800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787829968.661947:0:7257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3277:x1874675284133504:12345-0@lo:39:umount.0 Request processed in 152us (1783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829968.661955:0:7257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1787829968.661963:0:7257:0:(genops.c:885:class_export_put()) final put ffff9e9b75c71800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787829968.662531:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b75c71800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787829968.662602:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b50392800 for lustre-MDT0000 00010000:00010000:0.0:1787829968.663079:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787829968.664695:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9e9b50388000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787829968.664721:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1874675284133504:0@lo:39:umount.0 00000100:00080000:0.0:1787829968.666643:0:12933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787829968.666654:0:12933:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787829968.666663:0:12933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787829968.669772:0:12933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d785d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7864 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.669800:0:12933:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d785d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d7864 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.669809:0:12933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d785d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc03b4d103c0d7864 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.669817:0:12933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d785d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc03b4d103c0d7864 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.669878:0:12933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787829968.669886:0:12933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e000/0xc03b4d103c0d7784 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d778b expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.669893:0:12933:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e000/0xc03b4d103c0d7784 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d778b expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.669900:0:12933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e000/0xc03b4d103c0d7784 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc03b4d103c0d778b expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.669907:0:12933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e000/0xc03b4d103c0d7784 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc03b4d103c0d778b expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.669936:0:12933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787829968.669954:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787829968.669962:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d785d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc03b4d103c0d7864 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.669969:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40031e00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:0.0:1787829968.669974:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d785d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc03b4d103c0d7864 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.669984:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d785d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xc03b4d103c0d7864 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787829968.669992:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d785d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xc03b4d103c0d7864 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787829968.669998:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787829968.670008:0:5794:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1787829968.670070:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d785d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc03b4d103c0d7864 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.670078:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787829968.670114:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d785d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc03b4d103c0d7864 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.670122:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b40031e00/0xc03b4d103c0d785d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc03b4d103c0d7864 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.670139:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787829968.670142:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e000/0xc03b4d103c0d7784 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc03b4d103c0d778b expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.670148:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164e000 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:0.0:1787829968.670151:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e000/0xc03b4d103c0d7784 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc03b4d103c0d778b expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.670158:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e000/0xc03b4d103c0d7784 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc03b4d103c0d778b expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787829968.670165:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e000/0xc03b4d103c0d7784 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc03b4d103c0d778b expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787829968.670170:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787829968.670172:0:5794:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787829968.670175:0:5794:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787829968.670190:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e000/0xc03b4d103c0d7784 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc03b4d103c0d778b expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.670196:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787829968.670209:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e000/0xc03b4d103c0d7784 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc03b4d103c0d778b expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.670215:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b4164e000/0xc03b4d103c0d7784 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc03b4d103c0d778b expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.670229:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829968.670231:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829968.670234:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829968.670256:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f99b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284133760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787829968.670343:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829968.670404:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787829968.670411:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f99b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284133888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787829968.670434:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829968.670487:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284133760 00000100:00100000:0.0:1787829968.670494:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284133760 00000100:00100000:1.0:1787829968.670608:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284133888 00000100:00100000:1.0:1787829968.670613:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284133888 00010000:00010000:3.0:1787829968.671784:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829968.674411:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787829968.674425:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f383480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3280:x1874675284133760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787829968.674446:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829968.674473:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b596cbe00/0xc03b4d103c0d7864 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc03b4d103c0d785d expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.674491:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829968.674574:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f383480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:3280:x1874675284133760:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (4232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829968.674582:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787829968.674614:0:12933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3fc00/0xc03b4d103c0d7a78 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7a7f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.674647:0:12933:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3fc00/0xc03b4d103c0d7a78 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d7a7f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.674655:0:12933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3fc00/0xc03b4d103c0d7a78 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc03b4d103c0d7a7f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.674662:0:12933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3fc00/0xc03b4d103c0d7a78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc03b4d103c0d7a7f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.674682:0:12933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787829968.674694:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787829968.674701:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3fc00/0xc03b4d103c0d7a78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc03b4d103c0d7a7f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.674709:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3fc00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:0.0:1787829968.674713:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3fc00/0xc03b4d103c0d7a78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc03b4d103c0d7a7f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.674721:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3fc00/0xc03b4d103c0d7a78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc03b4d103c0d7a7f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787829968.674729:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3fc00/0xc03b4d103c0d7a78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc03b4d103c0d7a7f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787829968.674736:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787829968.674739:0:5793:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787829968.674742:0:5793:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787829968.674772:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3fc00/0xc03b4d103c0d7a78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc03b4d103c0d7a7f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.674787:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787829968.674812:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3fc00/0xc03b4d103c0d7a78 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc03b4d103c0d7a7f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.674819:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3fc00/0xc03b4d103c0d7a78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc03b4d103c0d7a7f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.674829:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829968.674831:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829968.674832:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829968.674840:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787829968.674857:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b52387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284134016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787829968.674899:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787829968.674958:0:12933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdbc00/0xc03b4d103c0d7538 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d753f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.674966:0:12933:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdbc00/0xc03b4d103c0d7538 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d753f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.674973:0:12933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdbc00/0xc03b4d103c0d7538 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc03b4d103c0d753f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.674979:0:12933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdbc00/0xc03b4d103c0d7538 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc03b4d103c0d753f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.674990:0:12933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787829968.674994:0:12933:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787829968.674997:0:12933:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1787829968.675053:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787829968.675063:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdbc00/0xc03b4d103c0d7538 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc03b4d103c0d753f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.675070:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b48cdbc00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:0.0:1787829968.675073:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdbc00/0xc03b4d103c0d7538 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc03b4d103c0d753f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.675080:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdbc00/0xc03b4d103c0d7538 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc03b4d103c0d753f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787829968.675085:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdbc00/0xc03b4d103c0d7538 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc03b4d103c0d753f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787829968.675092:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787829968.675094:0:5794:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787829968.675096:0:5794:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787829968.675107:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdbc00/0xc03b4d103c0d7538 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc03b4d103c0d753f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.675113:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787829968.675123:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdbc00/0xc03b4d103c0d7538 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc03b4d103c0d753f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.675129:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b48cdbc00/0xc03b4d103c0d7538 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc03b4d103c0d753f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.675143:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829968.675144:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829968.675145:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829968.675155:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284134144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787829968.675176:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829968.675203:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284134016 00000100:00100000:0.0:1787829968.675209:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284134016 00000100:00100000:3.0:1787829968.675397:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f99b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284133760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787829968.675894:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284134144 00000100:00100000:1.0:1787829968.675900:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284134144 00000100:00100000:1.0:1787829968.675923:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787829968.675932:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3803c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+19:3280:x1874675284133888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787829968.675943:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829968.675957:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b596ca400/0xc03b4d103c0d778b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc03b4d103c0d7784 expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829968.675973:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829968.676043:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3803c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+18:3280:x1874675284133888:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (5607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829968.676050:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787829968.676073:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787829968.676079:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+17:3279:x1874675284134144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787829968.676088:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787829968.676098:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b40030600/0xc03b4d103c0d753f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc03b4d103c0d7538 expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829968.676109:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787829968.676143:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ff77d2d-a894-4919-b9b2-0fa36523bae1+16:3279:x1874675284134144:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1787829968.676149:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787829968.676180:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284134144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787829968.676309:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f99b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3280:1874675284133888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787829968.676470:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787829968.676479:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ff77d2d-a894-4919-b9b2-0fa36523bae1+15:3279:x1874675284134016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787829968.676488:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787829968.676497:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b7feefe00/0xc03b4d103c0d7a7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc03b4d103c0d7a78 expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829968.676508:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787829968.676547:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ff77d2d-a894-4919-b9b2-0fa36523bae1+14:3279:x1874675284134016:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (1648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787829968.676554:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787829968.676599:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b52387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3279:1874675284134016:0@lo:103:ldlm_bl.0 00000020:01000004:0.0:1787829968.676725:0:12933:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787829968.676731:0:12933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787829968.676737:0:12933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787829968.676878:0:12933:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:0.0:1787829968.676886:0:12933:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9e9b75da1800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787829968.676892:0:12933:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9e9b7f82f800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787829968.676901:0:12933:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9e9b74f2e000 902200d4-578b-4474-a651-ffe6603128fa 192.168.201.51@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787829968.676906:0:12933:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9e9b6fb999b8) has exports, disconnecting them 00000020:00080000:0.0:1787829968.676922:0:12933:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e9b75da1800), last request at 1787829963 00000020:00000080:0.0:1787829968.676932:0:12933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d774c 00000100:00080000:0.0:1787829968.676954:0:12933:0:(import.c:65:import_set_state_nolock()) ffff9e9b75da5000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787829968.677207:0:12933:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e9b75da1800): rc 0 00000020:00000080:0.0:1787829968.677211:0:12933:0:(genops.c:885:class_export_put()) final put ffff9e9b75da1800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787829968.677227:0:12933:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e9b7f82f800), last request at 1787829963 00000020:00000080:0.0:1787829968.677231:0:12933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d7681 00000100:00080000:0.0:1787829968.677238:0:12933:0:(import.c:65:import_set_state_nolock()) ffff9e9b7f82b800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787829968.677313:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b75da1800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787829968.677370:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b75da5000 for lustre-MDT0000 00010000:00010000:3.0:1787829968.677468:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787829968.677551:0:12933:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e9b7f82f800): rc 0 00000020:00000080:0.0:1787829968.677554:0:12933:0:(genops.c:885:class_export_put()) final put ffff9e9b7f82f800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1787829968.677603:0:12933:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbcc5c1697ae0 00000100:00080000:0.0:1787829968.677631:0:12933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787829968.677635:0:12933:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1787829968.677660:0:12933:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787829968.677728:0:12933:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787829968.677753:0:12933:0:(import.c:65:import_set_state_nolock()) ffff9e9b81f08000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787829968.677773:0:12933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787829968.677775:0:12933:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1787829968.677785:0:12933:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787829968.677852:0:12933:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787829968.677864:0:12933:0:(import.c:65:import_set_state_nolock()) ffff9e9b75db0000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787829968.677899:0:12933:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9e9b6fb999b8) has no exports 00000100:00100000:0.0:1787829968.681901:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1874675284134272:0@lo:9:umount.0 00000100:00100000:0.0:1787829968.682056:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787829968.682125:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f311e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1874675284134400:0@lo:9:umount.0 00000100:00100000:0.0:1787829968.682149:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787829968.682540:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787829968.682566:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284134272 00000100:00100000:2.0:1787829968.682576:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284134272 00000100:00100000:2.0:1787829968.682820:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284134400 00000100:00100000:2.0:1787829968.682824:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284134400 00000100:00100000:2.0:1787829968.682863:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787829968.682874:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1874675284134272:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787829968.682908:0:6652:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d76ce 00000100:00080000:2.0:1787829968.682932:0:6652:0:(import.c:65:import_set_state_nolock()) ffff9e9b7f521000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787829968.682981:0:6652:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1787829968.683175:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fa461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:0:1874675284134528:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787829968.683569:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787829968.683575:0:5801:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787829968.683687:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3277:x1874675284134272:12345-0@lo:9:umount.0 Request processed in 812us (1630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787829968.683698:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787829968.683719:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787829968.683728:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1874675284134400:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787829968.683745:0:6652:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d77c3 00000100:00080000:2.0:1787829968.683754:0:6652:0:(import.c:65:import_set_state_nolock()) ffff9e9b6f928000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787829968.683784:0:6652:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:3.0:1787829968.683947:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787829968.683999:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3277:x1874675284134400:12345-0@lo:9:umount.0 Request processed in 271us (1847us total) trans 0 rc 0/0 00000020:00000080:1.0:1787829968.684209:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b7f82f800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787829968.684263:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b7f82b800 for lustre-MDT0000 00000100:00080000:0.0:1787829968.684378:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9e9b81f08000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787829968.684400:0:3277:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787829968.684403:0:3277:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787829968.684407:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1874675284134272:0@lo:9:umount.0 00000100:00080000:0.0:1787829968.684422:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9e9b75db0000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787829968.684438:0:3277:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787829968.684440:0:3277:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787829968.684443:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f311e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1874675284134400:0@lo:9:umount.0 00000100:00100000:2.0:1787829968.684719:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:2.0:1787829968.685193:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787829968.700239:0:12933:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9e9b6fb999b8) has no exports 00000100:00100000:1.0:1787829968.739383:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284134784:0@lo:400:kworker.0 00000100:00100000:3.0:1787829968.739407:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbeed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1874675284134656:0@lo:400:kworker.0 00000100:00100000:3.0:1787829968.742662:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829968.743558:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284134656 00000100:00100000:2.0:1787829968.743574:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284134656 00000100:00100000:2.0:1787829968.743639:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787829968.743649:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fa461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3281:x1874675284134656:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787829968.743660:0:5805:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787829968.743741:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fa461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3281:x1874675284134656:12345-0@lo:400:kworker.0 Request processed in 92us (1090us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787829968.743749:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:3.0:1787829968.743898:0:3281:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787829968.743905:0:3281:0:(import.c:65:import_set_state_nolock()) ffff9e9b7f83d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787829968.743940:0:3281:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1787829968.747335:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829968.753070:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284134784 00000100:00100000:2.0:1787829968.753103:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284134784 00000100:00100000:2.0:1787829968.753184:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787829968.753196:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3278:x1874675284134784:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787829968.753208:0:5806:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787829968.753325:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3278:x1874675284134784:12345-0@lo:400:kworker.0 Request processed in 130us (6000us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787829968.753333:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1787829968.753402:0:3278:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787829968.753409:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9e9b81f0b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787829968.753414:0:3278:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787829968.753421:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9e9b81f0b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787829968.753426:0:3278:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 154 00000100:00080000:2.0:1787829968.753434:0:3278:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e9b81f0b000 using connection 192.168.201.151@tcp/0@lo 00000100:00100000:2.0:1787829968.753476:0:3278:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b52387480 x1874675284134912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787829968.753506:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284134784:0@lo:400:kworker.0 00000100:00100000:2.0:1787829968.753573:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b52387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1874675284134912:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787829968.753628:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829968.753671:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284134912 00000100:00100000:2.0:1787829968.753675:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284134912 00000100:00100000:2.0:1787829968.753701:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787829968.753705:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1874675284134912:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1787829968.753723:0:5804:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000020:00000080:0.0:1787829968.764857:0:12933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d7593 00000020:00000080:0.0:1787829968.764874:0:12933:0:(genops.c:885:class_export_put()) final put ffff9e9b6fba9000/lustre-QMT0000_UUID 00000020:01000000:0.0:1787829968.764897:0:12933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787829968.765070:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b6fba9000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787829968.765125:0:12933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787829968.765139:0:12933:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787829968.765145:0:12933:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9e9b6fb9cd28) has no exports 00000020:00000080:1.0:1787829968.766740:0:12933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d758c 00000020:00000080:1.0:1787829968.766751:0:12933:0:(genops.c:885:class_export_put()) final put ffff9e9b75c77800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787829968.766928:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b75c77800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787829968.767003:0:12933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787829968.767074:0:12933:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787829968.767079:0:12933:0:(genops.c:885:class_export_put()) final put ffff9e9b6fbac800/lustre-QMT0000_UUID 00000020:00000080:1.0:1787829968.767082:0:12933:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b6fbac800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787829968.767088:0:12933:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00080000:3.0:1787829968.771068:0:3281:0:(import.c:65:import_set_state_nolock()) ffff9e9b7f83d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787829968.771085:0:3281:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 136 00000100:00080000:3.0:1787829968.771098:0:3281:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e9b7f83d000 using connection 192.168.201.151@tcp/0@lo 00000100:00100000:3.0:1787829968.771192:0:3281:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b7f99b480 x1874675284135040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787829968.771234:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbeed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1874675284134656:0@lo:400:kworker.0 00000100:00100000:0.0:1787829968.772045:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f99b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1874675284135040:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787829968.772127:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787829968.772759:0:10044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284135040 00000100:00100000:2.0:1787829968.772768:0:10044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284135040 00000100:00100000:2.0:1787829968.773595:0:10044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787829968.773605:0:10044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f311e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3277:x1874675284135040:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1787829968.773624:0:10044:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787829968.773690:0:10044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f311e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3277:x1874675284135040:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 85us (1562us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787829968.773698:0:10044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:0.0:1787829968.777122:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9e9b7f83d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787829968.777134:0:3277:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787829968.777139:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f99b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1874675284135040:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787829968.777262:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1874675284134912:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 23554us (23634us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787829968.777273:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1787829968.778385:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9e9b81f0b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787829968.778398:0:3277:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787829968.778404:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b52387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1874675284134912:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:2.0:1787829969.570228:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787829969.831296:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787829969.831306:0:6674:0:(genops.c:885:class_export_put()) final put ffff9e9b7f522800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787829969.831530:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b7f522800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787829969.831587:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b7f521000 for lustre-OST0000 00000001:00100000:0.0:1787829969.839121:0:5827:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 902200d4-578b-4474-a651-ffe6603128fa 00000001:00080000:0.0:1787829969.839140:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1787829969.839145:0:5827:0:(genops.c:885:class_export_put()) final put ffff9e9b74f2e000/902200d4-578b-4474-a651-ffe6603128fa 00000020:00000080:1.0:1787829969.839221:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b74f2e000/902200d4-578b-4474-a651-ffe6603128fa for lustre-MDT0000 00000020:00000080:1.0:1787829969.839273:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b74f2c000 for lustre-MDT0000 00010000:00010000:3.0:1787829970.596675:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787829970.786182:0:12933:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e9b7a50f0c0 - data ffff9e9b5d2dd438/ffff9e9b5390f800 00000020:01000000:1.0:1787829970.786385:0:12933:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e9b5abf8d20 - data ffff9e9b529d2d80/ffff9e9b6015ec00 00000001:00000004:1.0:1787829970.791733:0:12933:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1787829970.874510:0:12933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787829970.874519:0:12933:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1787829970.874586:0:12933:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787829970.874589:0:12933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787829970.875864:0:6745:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787829970.875869:0:6745:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1787829970.875889:0:6745:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1787829970.882007:0:12933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787829970.882032:0:12933:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1787829970.882044:0:12933:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787829970.882046:0:12933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787829970.882560:0:8049:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787829970.882564:0:8049:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1787829970.882573:0:8049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787829970.987619:0:12933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d755b 00000020:00000080:3.0:1787829970.987637:0:12933:0:(genops.c:885:class_export_put()) final put ffff9e9b6fb8f000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787829970.987862:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b6fb8f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787829970.989640:0:12933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d7570 00000020:00000080:3.0:1787829970.989650:0:12933:0:(genops.c:885:class_export_put()) final put ffff9e9b6fbab000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787829970.989675:0:12933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787829970.989684:0:12933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787829970.989692:0:12933:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787829970.989696:0:12933:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9e9b6fb94d28) has no exports 00000004:01000000:3.0:1787829970.989869:0:12933:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787829970.989887:0:12933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d77ae 00000020:00000080:3.0:1787829970.989892:0:12933:0:(genops.c:885:class_export_put()) final put ffff9e9b7f829800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787829970.989896:0:12933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787829970.989899:0:12933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787829970.989905:0:12933:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787829970.989908:0:12933:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9e9b74bf3370) has no exports 00000020:00000080:3.0:1787829970.989914:0:12933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d77a7 00000020:00000080:2.0:1787829970.989916:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b6fbab000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1787829970.989917:0:12933:0:(genops.c:885:class_export_put()) final put ffff9e9b6f92b800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787829970.989935:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b7f829800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787829970.989940:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b6f92b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787829970.990283:0:12933:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787829970.990296:0:12933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787829970.990300:0:12933:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1787829970.990306:0:12933:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787829970.990308:0:12933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787829970.990346:0:12933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787829970.990353:0:12933:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787829970.990357:0:12933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d76c7 00000020:00000080:3.0:1787829970.990362:0:12933:0:(genops.c:885:class_export_put()) final put ffff9e9b7f83b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787829970.990366:0:12933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787829970.990369:0:12933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787829970.990373:0:12933:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787829970.990375:0:12933:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9e9b69c2b370) has no exports 00000020:00000080:3.0:1787829970.990378:0:12933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d76c0 00000020:00000080:3.0:1787829970.990381:0:12933:0:(genops.c:885:class_export_put()) final put ffff9e9b81f09800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787829970.990381:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b75db0000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787829970.990387:0:8:0:(genops.c:885:class_export_put()) final put ffff9e9b6f92a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787829970.990390:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b6f92a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787829970.990416:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787829970.990477:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b7f83b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787829970.990481:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b81f09800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787829970.990705:0:12933:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787829970.990709:0:12933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787829970.990711:0:12933:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1787829970.990714:0:12933:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787829970.990716:0:12933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787829970.990755:0:12933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787829970.990761:0:12933:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787829970.990788:0:12933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787829970.990792:0:12933:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787829970.990796:0:12933:0:(genops.c:885:class_export_put()) final put ffff9e9b6fb89000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787829970.990798:0:12933:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b6fb89000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787829970.990803:0:12933:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787829970.990939:0:12933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d7577 00000020:00000080:3.0:1787829970.990944:0:12933:0:(genops.c:885:class_export_put()) final put ffff9e9b6fbab800/lustre-MDD0000_UUID 00000020:01000000:3.0:1787829970.990948:0:12933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1787829970.990951:0:12933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787829970.990954:0:12933:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787829970.990956:0:12933:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9e9b6fb98000) has no exports 00000020:00000080:3.0:1787829970.990980:0:12933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787829970.990984:0:12933:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1787829970.990987:0:12933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d757e 00000020:00000080:3.0:1787829970.990990:0:12933:0:(genops.c:885:class_export_put()) final put ffff9e9b6fbaf800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787829970.990998:0:12933:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e9b51a3b000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1787829970.991001:0:12933:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e9b51a3b000 3 00000020:01000004:3.0:1787829970.991004:0:12933:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e9b51a3b000 from lustre-MDT0000 00000020:00000080:3.0:1787829970.991044:0:12933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787829970.991048:0:12933:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1787829970.991050:0:12933:0:(genops.c:885:class_export_put()) final put ffff9e9b6f186800/lustre-MDT0000_UUID 00000020:00000080:3.0:1787829970.991053:0:12933:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b6f186800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1787829970.991059:0:12933:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1787829970.991085:0:12933:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1787829970.991089:0:12933:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1787829970.991091:0:12933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1787829970.991094:0:12933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787829970.991097:0:12933:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787829970.991103:0:12933:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9e9b4f86e800 6ff77d2d-a894-4919-b9b2-0fa36523bae1 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787829970.991109:0:12933:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9e9b52058000) has exports, disconnecting them 00000020:00080000:3.0:1787829970.991113:0:12933:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9e9b4f86e800), last request at 1787829736 00000020:00000080:3.0:1787829970.991126:0:12933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d7515 00000020:00010000:3.0:1787829970.991130:0:12933:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e9b4f86e800: total 2 00000100:00080000:3.0:1787829970.991133:0:12933:0:(import.c:65:import_set_state_nolock()) ffff9e9b4f86a000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787829970.991148:0:12933:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e9b4f86e800): rc 0 00000020:00080000:3.0:1787829970.991151:0:12933:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9e9b52058000) has no exports 00000100:00100000:3.0:1787829970.991200:0:5800:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9e9b535ec000:5800] 2 exiting: rc = 0 00000100:00100000:3.0:1787829970.991306:0:5799:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9e9b69d91200:5799] 1 exiting: rc = 0 00000020:00010000:0.0:1787829970.991485:0:5794:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e9b4f86e800: total 2 00010000:00010000:0.0:1787829970.991510:0:5794:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e9b4f86e800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1787829970.991537:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b40031a00/0xc03b4d103c0d7634 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc03b4d103c0d762d expref: 9 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829970.991558:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b4164ea00/0xc03b4d103c0d7872 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc03b4d103c0d786b expref: 8 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829970.991568:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b4164f000/0xc03b4d103c0d781e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc03b4d103c0d7817 expref: 7 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829970.991577:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b596cae00/0xc03b4d103c0d782c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc03b4d103c0d7825 expref: 6 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829970.991587:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b596caa00/0xc03b4d103c0d783a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc03b4d103c0d7833 expref: 5 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829970.991595:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b40031800/0xc03b4d103c0d7848 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc03b4d103c0d7841 expref: 4 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829970.991608:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d7a63 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc03b4d103c0d7a5c expref: 3 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829970.991618:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b40030400/0xc03b4d103c0d7a71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc03b4d103c0d7a6a expref: 2 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829970.991628:0:5794:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e9b4f86e800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1787829970.991650:0:5794:0:(genops.c:885:class_export_put()) final put ffff9e9b4f86e800/6ff77d2d-a894-4919-b9b2-0fa36523bae1 00010000:00010000:0.0:1787829970.991655:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829970.991657:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829970.991659:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829970.991678:0:5798:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9e9b69d91800:5798] 0 exiting: rc = 1 00000020:00000080:2.0:1787829970.991814:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b81f08000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787829970.991823:0:37:0:(genops.c:885:class_export_put()) final put ffff9e9b76a0f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787829970.991831:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b76a0f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787829970.991836:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787829970.991930:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b6fbab800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787829970.991934:0:37:0:(genops.c:885:class_export_put()) final put ffff9e9b6f181800/lustre-MDD0000_UUID 00000020:00000080:2.0:1787829970.991936:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b6f181800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787829970.991939:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1787829970.992100:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b6fbaf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787829970.992106:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b4f86e800/6ff77d2d-a894-4919-b9b2-0fa36523bae1 for MGS 00000020:00000080:2.0:1787829970.992130:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b4f86a000 for MGS 00000100:00100000:3.0:1787829970.992210:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992219:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992225:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992231:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992238:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992252:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992270:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992277:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992284:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992289:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992296:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992302:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992307:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992312:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992317:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992324:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992330:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992336:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992342:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992347:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992353:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992358:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992363:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992369:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992373:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992378:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992384:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992393:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992399:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992405:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992410:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992556:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992562:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992568:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992572:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992578:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992582:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992587:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992592:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992596:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992609:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992614:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992619:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992625:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992630:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992635:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992640:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992645:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992649:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992654:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992659:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992664:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992669:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992674:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992679:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992684:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992689:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992693:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992699:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992705:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992709:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992714:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992719:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829970.992724:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1787829970.993120:0:12933:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787829970.993123:0:12933:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1787829970.995958:0:12933:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e9b81b26de0 - data ffff9e9a41644948/ffff9e9b53905000 00000020:01000000:0.0:1787829970.996104:0:12933:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e9b430c54e0 - data ffff9e9b529d3a20/ffff9e9b69db8c00 00000020:00000080:0.0:1787829970.996581:0:12933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d7500 00000020:00000080:0.0:1787829970.996590:0:12933:0:(genops.c:885:class_export_put()) final put ffff9e9b52175800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787829970.996611:0:12933:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e9b51a3b000 from MGS, refs=2 00000020:01000004:0.0:1787829970.996615:0:12933:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e9b51a3b000 2 00000020:01000004:0.0:1787829970.996618:0:12933:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e9b51a3b000 from MGS 00000020:00000080:0.0:1787829970.996639:0:12933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787829970.996645:0:12933:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787829970.996648:0:12933:0:(genops.c:885:class_export_put()) final put ffff9e9b52171800/MGS 00000020:00000080:0.0:1787829970.996651:0:12933:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b52171800/MGS for MGS 00000020:01000000:0.0:1787829970.996660:0:12933:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787829970.996713:0:12933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787829970.996717:0:12933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787829970.996723:0:12933:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787829970.996731:0:12933:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9e9b5038c800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787829970.996736:0:12933:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9e9b4f844d28) has exports, disconnecting them 00000020:00080000:0.0:1787829970.996741:0:12933:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9e9b5038c800), last request at 1787829737 00000020:00000080:0.0:1787829970.996745:0:12933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d75cb 00000020:00080000:0.0:1787829970.996754:0:12933:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e9b5038c800): rc 0 00000020:00000080:0.0:1787829970.996758:0:12933:0:(genops.c:885:class_export_put()) final put ffff9e9b5038c800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787829970.997897:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b52175800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787829970.997912:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b5038c800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787829971.019274:0:12933:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787829971.019285:0:12933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787829971.019291:0:12933:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787829971.019298:0:12933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787829971.019368:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b50388000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787829971.019491:0:12933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787829971.019498:0:12933:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787829971.019504:0:12933:0:(genops.c:885:class_export_put()) final put ffff9e9b50389000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787829971.019508:0:12933:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b50389000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787829971.019517:0:12933:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787829971.019575:0:12933:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e9b51a3b000 1 00000020:00000080:2.0:1787829971.019582:0:12933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d74f2 00000020:00000080:2.0:1787829971.019588:0:12933:0:(genops.c:885:class_export_put()) final put ffff9e9b52177800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787829971.019602:0:12933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787829971.019607:0:12933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787829971.019612:0:12933:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787829971.019615:0:12933:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9e9b4f843370) has no exports 00000020:00000080:3.0:1787829971.020041:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b52177800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787829971.086631:0:12933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787829971.086642:0:12933:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787829971.086665:0:12933:0:(genops.c:885:class_export_put()) final put ffff9e9b51a3c800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787829971.086669:0:12933:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b51a3c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787829971.086674:0:12933:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787829971.086774:0:12933:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e9b51a38000 00000020:01000000:2.0:1787829971.086795:0:12933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787829971.086798:0:12933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787829971.086802:0:12933:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787829971.086806:0:12933:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9e9b4f840000) has no exports 00000100:00100000:2.0:1787829971.087350:0:10044:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9e9b76acc200:10044] 4 exiting: rc = 0 00000100:00100000:1.0:1787829971.087369:0:7257:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9e9b51e72000:7257] 3 exiting: rc = 0 00000100:00100000:1.0:1787829971.087859:0:5805:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9e9b69e30000:5805] 1 exiting: rc = 0 00000100:00100000:0.0:1787829971.088237:0:5806:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9e9b69e31e00:5806] 2 exiting: rc = 0 00000100:00100000:0.0:1787829971.088313:0:5804:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9e9b69e30a00:5804] 0 exiting: rc = 1 00000100:00100000:2.0:1787829971.088722:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088729:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088734:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088740:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088745:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088750:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088755:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088760:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088766:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088771:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088778:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088786:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088793:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088801:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088808:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088816:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088822:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088830:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088837:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088843:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088850:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088858:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088866:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088885:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088894:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088914:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088921:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088929:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088938:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088946:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088953:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088961:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088969:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088977:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088985:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.088994:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089000:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089003:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089011:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089034:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089039:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089043:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089047:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089051:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089059:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089063:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089069:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089073:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089078:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089082:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089088:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089091:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089096:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089118:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089124:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089131:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089136:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089142:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089146:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089149:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089157:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089161:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089164:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.089168:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.096570:0:5807:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9e9b431be600:5807] 0 exiting: rc = 1 00000100:00100000:0.0:1787829971.096605:0:5808:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9e9b535ec600:5808] 1 exiting: rc = 0 00000100:00100000:2.0:1787829971.096858:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.096868:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.096886:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.096896:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.096904:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.096912:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.096921:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.096928:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.096935:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.096943:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.096951:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.096960:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.096968:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.096974:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.096981:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.096987:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.096994:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097000:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097006:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097040:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097051:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097060:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097067:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097072:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097084:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097090:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097095:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097101:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097108:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097114:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097120:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097137:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097143:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097149:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097159:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097164:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097175:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097180:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097185:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097190:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097196:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097203:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097210:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097216:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097223:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097229:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097236:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097243:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097249:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097265:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097273:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097281:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097548:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097556:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097561:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097565:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097568:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097572:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097576:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097578:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097581:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097584:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097587:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.097591:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.098131:0:5810:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9e9b69e30e00:5810] 1 exiting: rc = 0 00000100:00100000:1.0:1787829971.098146:0:5809:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9e9b69e31c00:5809] 0 exiting: rc = 1 00000100:00100000:3.0:1787829971.098175:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098194:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098498:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098507:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098513:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098527:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098539:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098546:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098553:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098560:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098567:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098574:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098579:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098584:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098590:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098595:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098601:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098608:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098633:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098642:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098651:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098658:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098666:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098674:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098682:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098691:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098699:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098704:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098710:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098715:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098733:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098740:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098746:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098752:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098757:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098763:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098770:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098777:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098785:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098791:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098807:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098815:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098843:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098853:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098864:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098887:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098895:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098901:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098914:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098921:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098928:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098935:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098943:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098951:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098984:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098992:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.098998:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.099006:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.099046:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.099055:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.099063:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.099071:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.099078:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.099096:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.112217:0:5811:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9e9b69de9000:5811] 0 exiting: rc = 1 00000100:00100000:0.0:1787829971.112217:0:5812:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9e9b69df4400:5812] 1 exiting: rc = 0 00000100:00100000:2.0:1787829971.112422:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112437:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112442:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112447:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112453:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112458:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112463:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112467:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112473:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112477:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112482:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112486:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112492:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112497:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112502:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112507:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112512:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112517:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112522:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112526:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112532:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112536:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112541:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112546:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112551:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112556:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112560:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112564:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112569:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112574:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112578:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112582:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112587:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112592:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112597:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112602:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112614:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112618:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112623:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112630:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112636:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112645:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112651:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112658:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112664:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112671:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112678:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112686:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112692:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112699:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112704:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112709:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112714:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112718:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112722:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112727:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112732:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112737:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112741:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112746:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112750:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112754:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112759:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.112763:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113174:0:5813:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9e9b69df5200:5813] 0 exiting: rc = 1 00000100:00100000:0.0:1787829971.113236:0:5814:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9e9b69df5a00:5814] 1 exiting: rc = 0 00000100:00100000:2.0:1787829971.113430:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113436:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113442:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113447:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113461:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113470:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113484:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113489:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113493:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113498:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113503:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113507:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113512:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113517:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113522:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113527:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113532:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113537:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113541:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113546:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113550:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113555:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113560:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113565:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113569:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113579:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113588:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113595:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113600:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113604:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113609:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113613:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113660:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113666:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113671:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113676:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113681:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113687:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113693:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113697:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113702:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113714:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113718:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113723:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113727:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113733:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113738:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113743:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113748:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113753:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113758:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113763:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113809:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113815:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113819:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113823:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113828:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113833:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113837:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113841:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113845:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113850:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113853:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.113859:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116101:0:5816:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9e9b69df5000:5816] 1 exiting: rc = 0 00000100:00100000:0.0:1787829971.116101:0:5815:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9e9b69df4800:5815] 0 exiting: rc = 1 00000100:00100000:2.0:1787829971.116520:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116527:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116532:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116537:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116542:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116547:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116553:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116558:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116564:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116569:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116574:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116588:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116594:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116599:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116714:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116719:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116724:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116729:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116733:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116738:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116742:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116747:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116756:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116761:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116766:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116775:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116780:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116784:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116789:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116795:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116804:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116809:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116813:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116818:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116823:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116828:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116833:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116838:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116842:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116847:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116852:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116857:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116863:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116868:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116883:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116887:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116901:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116905:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116910:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116915:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116920:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116925:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116930:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116936:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116942:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116947:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116958:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116963:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116969:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116974:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116978:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116984:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116989:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.116993:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829971.119219:0:5818:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9e9b69df4e00:5818] 1 exiting: rc = 0 00000100:00100000:0.0:1787829971.119247:0:5817:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9e9b69de9c00:5817] 0 exiting: rc = 1 00000100:00100000:2.0:1787829971.119414:0:5819:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9e9b69de8e00:5819] 2 exiting: rc = 0 00000100:00100000:3.0:1787829971.120086:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120096:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120104:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120111:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120119:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120126:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120149:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120158:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120167:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120178:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120200:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120206:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120212:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120217:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120223:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120229:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120235:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120246:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120264:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120270:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120276:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120282:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120291:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120298:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120303:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120310:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120315:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120320:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120329:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120335:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120353:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120361:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120366:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120371:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120377:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120383:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120388:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120395:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120505:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120510:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120516:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120522:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120527:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120532:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120537:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120550:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120556:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120561:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120567:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120572:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120577:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120591:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120597:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120602:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120628:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120636:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120641:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120647:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120654:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120660:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120665:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120670:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120675:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829971.120686:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787829971.132440:0:12933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787829971.132455:0:12933:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787829971.132461:0:12933:0:(genops.c:885:class_export_put()) final put ffff9e9b52175000/MDS_uuid 00000020:00000080:2.0:1787829971.132466:0:12933:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b52175000/MDS_uuid for MDS 00000020:01000000:2.0:1787829971.132476:0:12933:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787829971.132620:0:12933:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787829971.618304:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787829971.884764:0:7602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787829971.884772:0:7602:0:(genops.c:885:class_export_put()) final put ffff9e9b6f92a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787829971.884850:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b6f92a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787829971.884912:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b6f928000 for lustre-OST0001 00010000:00010000:3.0:1787829972.642220:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829973.666340:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787829973.858609:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787829973.858617:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787829973.858620:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e9b7f83d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787829973.858629:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 348 00000100:00080000:1.0:1787829973.858635:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787829973.858641:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e9b7f83d000 using connection 192.168.201.151@tcp/0@lo 00000100:00100000:1.0:1787829973.858664:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b7fbed2c0 x1874675284135296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787829973.858680:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787829973.858683:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787829973.858685:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e9b81f0b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787829973.858688:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 348 00000100:00080000:1.0:1787829973.858690:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787829973.858694:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e9b81f0b000 using connection 192.168.201.151@tcp/0@lo 00000100:00100000:1.0:1787829973.858710:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b7fbec000 x1874675284135424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787829973.858730:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787829973.858746:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284135168:0@lo:400:kworker.0 00000400:00000100:1.0:1787829973.858792:0:3278:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874675284135168 offset 0 length 224: 4 00000100:00100000:1.0:1787829973.858856:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1874675284135296:0@lo:38:kworker.0 00000400:00000100:1.0:1787829973.858876:0:3277:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874675284135296 offset 0 length 520: 4 00000100:00100000:1.0:1787829973.858887:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1874675284135424:0@lo:38:kworker.0 00000400:00000100:1.0:1787829973.858897:0:3277:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874675284135424 offset 0 length 520: 4 00000020:01000004:0.0:1787829974.146197:0:13088:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787829974.162431:0:13088:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787829974.162478:0:13088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fa00/0xc03b4d103c0d7833 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d783a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829974.162493:0:13088:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fa00/0xc03b4d103c0d7833 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d783a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829974.162501:0:13088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fa00/0xc03b4d103c0d7833 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc03b4d103c0d783a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829974.162508:0:13088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fa00/0xc03b4d103c0d7833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc03b4d103c0d783a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829974.162531:0:13088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787829974.162536:0:13088:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787829974.162559:0:13088:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787829974.162570:0:13088:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e9b7fbed2c0 x1874675284135296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787829988 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829974.162586:0:13088:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787829974.162591:0:13088:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787829974.162597:0:13088:0:(import.c:65:import_set_state_nolock()) ffff9e9b7f83d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787829974.162601:0:13088:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787829974.162607:0:13088:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e9b7fbed2c0 x1874675284135296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787829988 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787829974.162613:0:13088:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787829974.162627:0:13088:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00010000:00010000:2.0:1787829974.162677:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787829974.162683:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fa00/0xc03b4d103c0d7833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc03b4d103c0d783a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829974.162691:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b4164fa00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:2.0:1787829974.162708:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fa00/0xc03b4d103c0d7833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc03b4d103c0d783a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829974.162718:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fa00/0xc03b4d103c0d7833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc03b4d103c0d783a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787829974.162725:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fa00/0xc03b4d103c0d7833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc03b4d103c0d783a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787829974.162730:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787829974.162733:0:5793:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787829974.162735:0:5793:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787829974.162767:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fa00/0xc03b4d103c0d7833 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc03b4d103c0d783a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829974.162772:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787829974.162799:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fa00/0xc03b4d103c0d7833 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc03b4d103c0d783a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829974.162807:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b4164fa00/0xc03b4d103c0d7833 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc03b4d103c0d783a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829974.162832:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829974.162834:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829974.162835:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829974.162897:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1874675284135296:0@lo:38:kworker.0 00010000:00010000:2.0:1787829974.163843:0:13088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7841 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7848 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829974.163856:0:13088:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7841 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d7848 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829974.163862:0:13088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7841 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc03b4d103c0d7848 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829974.163879:0:13088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7841 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc03b4d103c0d7848 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829974.163902:0:13088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787829974.163910:0:13088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d7a6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7a71 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829974.163915:0:13088:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d7a6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d7a71 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829974.163921:0:13088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d7a6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc03b4d103c0d7a71 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829974.163927:0:13088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d7a6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc03b4d103c0d7a71 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829974.163937:0:13088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787829974.163940:0:13088:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1787829974.163960:0:13088:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1787829974.163965:0:13088:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1787829974.163969:0:13088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787829974.163974:0:13088:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787829974.163978:0:13088:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9e9b7f580000) has no exports 00000020:00080000:2.0:1787829974.164003:0:13088:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9e9b7f580000) has no exports 00000020:01000000:2.0:1787829974.165724:0:13088:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e9b69c83300 - data ffff9e9b7fc8d948/ffff9e9b6fa7dc00 00010000:00010000:1.0:1787829974.166210:0:11133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787829974.166222:0:11133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7841 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc03b4d103c0d7848 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829974.166233:0:11133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b48cda600 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:1.0:1787829974.166237:0:11133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7841 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc03b4d103c0d7848 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829974.166248:0:11133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc03b4d103c0d7848 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787829974.166255:0:11133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc03b4d103c0d7848 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787829974.166261:0:11133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787829974.166263:0:11133:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1787829974.166279:0:11133:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1787829974.166323:0:11133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7841 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc03b4d103c0d7848 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829974.166330:0:11133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787829974.166345:0:11133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7841 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc03b4d103c0d7848 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829974.166352:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda600/0xc03b4d103c0d7841 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc03b4d103c0d7848 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787829974.166453:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3281:1874675284135680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787829974.166529:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787829974.166604:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787829974.166612:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3281:1874675284135552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787829974.166636:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787829974.166722:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787829974.166729:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d7a6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc03b4d103c0d7a71 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829974.166736:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40030a00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:0.0:1787829974.166739:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d7a6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc03b4d103c0d7a71 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829974.166746:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d7a6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc03b4d103c0d7a71 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787829974.166753:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d7a6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc03b4d103c0d7a71 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787829974.166758:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787829974.166761:0:5794:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787829974.166762:0:5794:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787829974.166776:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d7a6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc03b4d103c0d7a71 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829974.166780:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787829974.166796:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d7a6a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc03b4d103c0d7a71 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787829974.166802:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b40030a00/0xc03b4d103c0d7a6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc03b4d103c0d7a71 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829974.170261:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829974.170268:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829974.170271:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787829974.170326:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f313c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284135808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787829974.170407:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787829974.170468:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284135680 00000100:00100000:1.0:1787829974.170475:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284135680 00000100:00100000:1.0:1787829974.170515:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284135552 00000100:00100000:1.0:1787829974.170518:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284135552 00000100:00100000:1.0:1787829974.170527:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284135808 00000100:00100000:1.0:1787829974.170529:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284135808 00000100:00100000:1.0:1787829974.170541:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787829974.170548:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b4fae6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3281:x1874675284135680:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787829974.170555:0:5792:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787829974 with bad export cookie 13851749811030422805 00000100:00100000:3.0:1787829974.171094:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787829974.171101:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f99b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3281:x1874675284135552:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787829974.171106:0:5791:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787829974 with bad export cookie 13851749811030422805 00000100:00100000:3.0:1787829974.171169:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f99b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3281:x1874675284135552:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (4531us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787829974.171190:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787829974.171207:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787829974.171211:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbee580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3278:x1874675284135808:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787829974.171216:0:5791:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787829974 with bad export cookie 13851749811030422805 00000100:00100000:3.0:1787829974.171263:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbee580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3278:x1874675284135808:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (856us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787829974.171269:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1787829974.171302:0:3278:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.151@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787829974.171307:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9e9b4f86b000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787829974.171311:0:3278:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.151@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1787829974.171378:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829974.171381:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829974.171382:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787829974.178333:0:13088:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e9b430b53c0 - data ffff9e9a41408d80/ffff9e9b81b01400 00000100:00100000:1.0:1787829974.180682:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b4fae6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3281:x1874675284135680:12345-0@lo:103:ldlm_bl.0 Request processed in 10127us (14147us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787829974.180693:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1787829974.182221:0:3281:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.151@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787829974.191380:0:3278:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.151@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787829974.191386:0:3278:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787829974.191396:0:3278:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e9b7fbecf00 x1874675284135168/t0(0) o400->MGC192.168.201.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787829989 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829974.191410:0:3278:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e9b7fbed2c0 x1874675284135680/t0(0) o103->MGC192.168.201.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787829990 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829974.191420:0:3278:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e9b7f3ccb40 x1874675284135552/t0(0) o103->MGC192.168.201.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787829990 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787829974.191428:0:3278:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e9b7f313c00 x1874675284135808/t0(0) o103->MGC192.168.201.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787829990 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787829974.191443:0:3278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787829974.191446:0:3278:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787829974.191447:0:3278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787829974.191475:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9e9b4f86b000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787829974.191476:0:3281:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9e9b4f86b000 already not connected (conn 1, was 1): DISCONN 00000100:00080000:3.0:1787829974.191481:0:3278:0:(import.c:510:import_select_connection()) MGC192.168.201.151@tcp: connect to NID 0@lo last attempt 116 00000100:00080000:3.0:1787829974.191490:0:3278:0:(import.c:624:import_select_connection()) MGC192.168.201.151@tcp: import ffff9e9b4f86b000 using connection 192.168.201.151@tcp/0@lo 00000100:00100000:2.0:1787829974.191520:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3281:1874675284135680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787829974.191522:0:3278:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b7f99a1c0 x1874675284135936/t0(0) o250->MGC192.168.201.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787829974.191550:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3281:1874675284135552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787829974.191602:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f99a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3277:1874675284135936:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:1.0:1787829974.191652:0:3277:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874675284135936 offset 0 length 520: 4 00000100:00100000:3.0:1787829974.191787:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284135168:0@lo:400:kworker.0 00000100:00100000:3.0:1787829974.191802:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f313c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3278:1874675284135808:0@lo:103:ldlm_bl.0 00100000:10000000:2.0:1787829974.206716:0:13088:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787829974.230214:0:13088:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d7650 00000020:00000080:2.0:1787829974.230225:0:13088:0:(genops.c:885:class_export_put()) final put ffff9e9b7f521800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787829974.230477:0:13088:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e9b53977800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787829974.230481:0:13088:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e9b53977800 2 00000020:01000004:2.0:1787829974.230484:0:13088:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e9b53977800 from lustre-OST0000 00000020:00000080:2.0:1787829974.230503:0:13088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787829974.230511:0:13088:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787829974.230514:0:13088:0:(genops.c:885:class_export_put()) final put ffff9e9b7f520800/lustre-OST0000_UUID 00000020:00000080:2.0:1787829974.230516:0:13088:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b7f520800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787829974.230521:0:13088:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787829974.230552:0:13088:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787829974.230555:0:13088:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787829974.230558:0:13088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787829974.230561:0:13088:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787829974.230567:0:13088:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9e9b7f83a000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787829974.230571:0:13088:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9e9b5205cd28) has exports, disconnecting them 00000020:00080000:2.0:1787829974.230574:0:13088:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9e9b7f83a000), last request at 1787829756 00000020:00000080:2.0:1787829974.230577:0:13088:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d767a 00000020:00080000:2.0:1787829974.230585:0:13088:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e9b7f83a000): rc 0 00000020:00000080:2.0:1787829974.230588:0:13088:0:(genops.c:885:class_export_put()) final put ffff9e9b7f83a000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787829974.230775:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b7f521800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787829974.230794:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b7f83a000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787829974.248296:0:13088:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787829974.248305:0:13088:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787829974.248309:0:13088:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787829974.248316:0:13088:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787829974.248662:0:13088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787829974.248681:0:13088:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1787829974.248688:0:13088:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e9b53977800 1 00000020:00000080:2.0:1787829974.248695:0:13088:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d760a 00000020:00000080:2.0:1787829974.248714:0:13088:0:(genops.c:885:class_export_put()) final put ffff9e9b51bfa800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787829974.248974:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b7f83d000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787829974.248983:0:36:0:(genops.c:885:class_export_put()) final put ffff9e9b76ab6800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1787829974.248986:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b76ab6800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1787829974.248998:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1787829974.249239:0:13088:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787829974.249302:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b51bfa800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787829974.249473:0:13088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787829974.249480:0:13088:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787829974.249484:0:13088:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9e9b69c2cd28) has no exports 00000020:00000080:3.0:1787829974.267255:0:13088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787829974.267271:0:13088:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1787829974.267276:0:13088:0:(genops.c:885:class_export_put()) final put ffff9e9b53972000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1787829974.267280:0:13088:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b53972000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1787829974.267291:0:13088:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1787829974.267444:0:13088:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e9b53971000 00000020:02000400:3.0:1787829974.267488:0:13088:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1787829974.691173:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829975.714248:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829976.740300:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787829977.430368:0:13238:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787829977.437746:0:13238:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787829977.437837:0:13238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b40030c00/0xc03b4d103c0d7817 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d781e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829977.437854:0:13238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b40030c00/0xc03b4d103c0d7817 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d781e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829977.437861:0:13238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b40030c00/0xc03b4d103c0d7817 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc03b4d103c0d781e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829977.437868:0:13238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.151@tcp lock: ffff9e9b40030c00/0xc03b4d103c0d7817 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc03b4d103c0d781e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829977.437973:0:13238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787829977.437979:0:13238:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787829977.438007:0:13238:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787829977.438151:0:13238:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e9b7fbec000 x1874675284135424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787829988 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787829977.438171:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787829977.438171:0:13238:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00010000:00010000:2.0:1787829977.438178:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b40030c00/0xc03b4d103c0d7817 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc03b4d103c0d781e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787829977.438178:0:13238:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787829977.438184:0:13238:0:(import.c:65:import_set_state_nolock()) ffff9e9b81f0b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:2.0:1787829977.438185:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40030c00 already unused, calling callback (ffffffffc1c3fc20) 00000100:00080000:1.0:1787829977.438188:0:13238:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:00010000:2.0:1787829977.438189:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b40030c00/0xc03b4d103c0d7817 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc03b4d103c0d781e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829977.438192:0:13238:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e9b7fbec000 x1874675284135424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787829988 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787829977.438198:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b40030c00/0xc03b4d103c0d7817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc03b4d103c0d781e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787829977.438198:0:13238:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787829977.438201:0:13238:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 10000000:00010000:2.0:1787829977.438205:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b40030c00/0xc03b4d103c0d7817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc03b4d103c0d781e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787829977.438211:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787829977.438213:0:5793:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787829977.438216:0:5793:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787829977.438229:0:5793:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e9b4f86b000 00010000:00010000:2.0:1787829977.438233:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b40030c00/0xc03b4d103c0d7817 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc03b4d103c0d781e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829977.438239:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b40030c00/0xc03b4d103c0d7817 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc03b4d103c0d781e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829977.438250:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787829977.438260:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1874675284135424:0@lo:38:kworker.0 00010000:00010000:2.0:1787829977.438266:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829977.438267:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787829977.439163:0:13238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7825 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d782c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829977.439188:0:13238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7825 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d782c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829977.439195:0:13238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7825 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc03b4d103c0d782c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829977.439202:0:13238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc03b4d103c0d782c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829977.439220:0:13238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787829977.439227:0:13238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e400/0xc03b4d103c0d7a5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d7a63 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829977.439234:0:13238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e400/0xc03b4d103c0d7a5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d7a63 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829977.439241:0:13238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e400/0xc03b4d103c0d7a5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc03b4d103c0d7a63 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829977.439247:0:13238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e400/0xc03b4d103c0d7a5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc03b4d103c0d7a63 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829977.439260:0:13238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787829977.439263:0:13238:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1787829977.439281:0:13238:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1787829977.439284:0:13238:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1787829977.439289:0:13238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787829977.439294:0:13238:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787829977.439298:0:13238:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9e9b69c299b8) has no exports 00000020:00080000:1.0:1787829977.439328:0:13238:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9e9b69c299b8) has no exports 00010000:00010000:2.0:1787829977.439380:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787829977.439386:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc03b4d103c0d782c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829977.439393:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b48cda000 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:2.0:1787829977.439396:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc03b4d103c0d782c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829977.439403:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc03b4d103c0d782c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787829977.439411:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc03b4d103c0d782c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787829977.439416:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787829977.439418:0:5794:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1787829977.439420:0:5794:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1787829977.439440:0:5794:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e9b4f86b000 00010000:00010000:2.0:1787829977.439444:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7825 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc03b4d103c0d782c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829977.439451:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b48cda000/0xc03b4d103c0d7825 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc03b4d103c0d782c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829977.439462:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787829977.439465:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e400/0xc03b4d103c0d7a5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc03b4d103c0d7a63 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829977.439470:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3e400 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:2.0:1787829977.439478:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e400/0xc03b4d103c0d7a5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc03b4d103c0d7a63 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829977.439485:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e400/0xc03b4d103c0d7a5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc03b4d103c0d7a63 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787829977.439492:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e400/0xc03b4d103c0d7a5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc03b4d103c0d7a63 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787829977.439497:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787829977.439499:0:5794:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787829977.439501:0:5794:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787829977.439506:0:5794:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e9b4f86b000 00010000:00010000:2.0:1787829977.439508:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e400/0xc03b4d103c0d7a5c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc03b4d103c0d7a63 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829977.439514:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e400/0xc03b4d103c0d7a5c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc03b4d103c0d7a63 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787829977.439527:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829977.439528:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787829977.439530:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787829977.439849:0:11133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787829977.441013:0:13238:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e9b69c83780 - data ffff9e9b5e7d0948/ffff9e9b6fa7e400 00000020:01000000:0.0:1787829977.441218:0:13238:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e9b6f86b120 - data ffff9e9b5d195ca8/ffff9e9b4f977400 00100000:10000000:0.0:1787829977.452150:0:13238:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787829977.473087:0:13238:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d771b 00000020:00000080:1.0:1787829977.473095:0:13238:0:(genops.c:885:class_export_put()) final put ffff9e9b75db7800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1787829977.473106:0:13238:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e9b7f524800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1787829977.473108:0:13238:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e9b7f524800 2 00000020:01000004:1.0:1787829977.473111:0:13238:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e9b7f524800 from lustre-OST0001 00000020:00000080:1.0:1787829977.473126:0:13238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787829977.473134:0:13238:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1787829977.473136:0:13238:0:(genops.c:885:class_export_put()) final put ffff9e9b81f0e000/lustre-OST0001_UUID 00000020:00000080:1.0:1787829977.473138:0:13238:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b81f0e000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1787829977.473143:0:13238:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:3.0:1787829977.473217:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b75db7800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:1.0:1787829977.473293:0:13238:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 6ff77d2d-a894-4919-b9b2-0fa36523bae1->MGS 00010000:00010000:1.0:1787829977.473317:0:13238:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b596cba00/0xc03b4d103c0d762d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc03b4d103c0d7634 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787829977.473330:0:13238:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b596cba00/0xc03b4d103c0d762d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc03b4d103c0d7634 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787829977.473345:0:13238:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1787829977.473349:0:13238:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1787829977.473352:0:13238:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1787829977.473365:0:13238:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e9b4f86b000 00010000:00010000:1.0:1787829977.473368:0:13238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b596cba00/0xc03b4d103c0d762d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc03b4d103c0d7634 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787829977.473380:0:13238:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b40031400/0xc03b4d103c0d786b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc03b4d103c0d7872 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787829977.473387:0:13238:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b40031400/0xc03b4d103c0d786b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc03b4d103c0d7872 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787829977.473416:0:13238:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787829977.473418:0:13238:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1787829977.473420:0:13238:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1787829977.473431:0:13238:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e9b4f86b000 00010000:00010000:1.0:1787829977.473434:0:13238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b40031400/0xc03b4d103c0d786b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc03b4d103c0d7872 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787829977.473448:0:13238:0:(import.c:65:import_set_state_nolock()) ffff9e9b4f86b000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1787829977.473451:0:13238:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787829977.473453:0:13238:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787829977.473454:0:13238:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787829977.473457:0:13238:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787829977.473466:0:13238:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e9b7f99a1c0 x1874675284135936/t0(0) o250->MGC192.168.201.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787829984 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787829977.473479:0:13238:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787829977.473481:0:13238:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:2.0:1787829977.473518:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f99a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6ff77d2d-a894-4919-b9b2-0fa36523bae1:3277:1874675284135936:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:1.0:1787829977.473667:0:13238:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787829977.473674:0:13238:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d750e 00000020:00000080:1.0:1787829977.473677:0:13238:0:(genops.c:885:class_export_put()) final put ffff9e9b4f86b800/6ff77d2d-a894-4919-b9b2-0fa36523bae1 00000020:01000000:1.0:1787829977.473730:0:13238:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.151@tcp (flags='') 00000020:00000080:1.0:1787829977.473734:0:13238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787829977.473738:0:13238:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.151@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787829977.473741:0:13238:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9e9b4f8419b8) has no exports 10000000:01000000:2.0:1787829977.473791:0:5802:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:3.0:1787829977.473795:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b4f86b800/6ff77d2d-a894-4919-b9b2-0fa36523bae1 for MGC192.168.201.151@tcp 10000000:01000000:1.0:1787829977.473808:0:13238:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.151@tcp: client import never connected 00000100:00080000:1.0:1787829977.473811:0:13238:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787829977.473813:0:13238:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787829977.473816:0:13238:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787829977.473818:0:13238:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787829977.473859:0:13238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787829977.473868:0:13238:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.151@tcp (uuid 6ff77d2d-a894-4919-b9b2-0fa36523bae1) 00000020:01000000:1.0:1787829977.473873:0:13238:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787829977.473881:0:13238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787829977.473885:0:13238:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787829977.473890:0:13238:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9e9b75db2800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787829977.473895:0:13238:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9e9b69c28000) has exports, disconnecting them 00000020:00080000:1.0:1787829977.473899:0:13238:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9e9b75db2800), last request at 1787829774 00000020:00000080:1.0:1787829977.473903:0:13238:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d7745 00000020:00080000:1.0:1787829977.473913:0:13238:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e9b75db2800): rc 0 00000020:00000080:1.0:1787829977.473917:0:13238:0:(genops.c:885:class_export_put()) final put ffff9e9b75db2800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787829977.473924:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b4f86b000 for MGC192.168.201.151@tcp 00000020:00000080:3.0:1787829977.473929:0:8:0:(genops.c:885:class_export_put()) final put ffff9e9b4f868000/6ff77d2d-a894-4919-b9b2-0fa36523bae1 00000020:00000080:3.0:1787829977.473931:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b4f868000/6ff77d2d-a894-4919-b9b2-0fa36523bae1 for MGC192.168.201.151@tcp 00000020:01000000:3.0:1787829977.473935:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.151@tcp (6ff77d2d-a894-4919-b9b2-0fa36523bae1) 00000020:00000080:3.0:1787829977.474283:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b75db2800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787829977.475088:0:13238:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787829977.475093:0:13238:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787829977.475097:0:13238:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787829977.475102:0:13238:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787829977.475145:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b81f0b000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1787829977.475155:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1787829977.475318:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1787829977.475921:0:11133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1787829977.476357:0:5788:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9e9b54295a00:5788] 0 exiting: rc = 1 00000100:00100000:2.0:1787829977.476491:0:5789:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9e9b51ea1800:5789] 1 exiting: rc = 0 00000100:00100000:2.0:1787829977.476557:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.476873:0:5791:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9e9b72913800:5791] 1 exiting: rc = 0 00000100:00100000:3.0:1787829977.476929:0:5790:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9e9b72913600:5790] 0 exiting: rc = 1 00000100:00100000:0.0:1787829977.478701:0:8409:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9e9b749d6400:8409] 3 exiting: rc = 0 00000100:00100000:2.0:1787829977.479163:0:5792:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9e9b431bee00:5792] 2 exiting: rc = 0 00000100:00100000:3.0:1787829977.479539:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479558:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479568:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479575:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479581:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479587:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479592:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479598:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479604:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479610:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479615:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479624:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479630:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479635:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479642:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479647:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479657:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479662:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479667:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479671:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479676:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479681:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479685:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479690:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479694:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479698:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479703:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479707:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479711:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479719:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479723:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479727:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479732:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479737:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479741:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479745:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479755:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479772:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479778:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479784:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479791:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479798:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479803:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479810:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479944:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479949:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479953:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479958:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479963:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479967:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479971:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479976:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479980:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479984:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479987:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479992:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.479995:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.480000:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.480003:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.480007:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.480011:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.480039:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.480044:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.480049:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787829977.481203:0:13238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787829977.481213:0:13238:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787829977.481218:0:13238:0:(genops.c:885:class_export_put()) final put ffff9e9b75db6800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787829977.481222:0:13238:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b75db6800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787829977.481228:0:13238:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1787829977.481486:0:13238:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e9b7f524800 1 00000020:00000080:3.0:1787829977.481500:0:13238:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc03b4d103c0d76ea 00000020:00000080:3.0:1787829977.481507:0:13238:0:(genops.c:885:class_export_put()) final put ffff9e9b52056800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787829977.481550:0:13238:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787829977.481555:0:13238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787829977.481559:0:13238:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787829977.481563:0:13238:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9e9b7f584d28) has no exports 00000020:00000080:2.0:1787829977.485676:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b52056800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787829977.506800:0:13238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787829977.506817:0:13238:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787829977.506822:0:13238:0:(genops.c:885:class_export_put()) final put ffff9e9b6fb8e800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787829977.506827:0:13238:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b6fb8e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787829977.506836:0:13238:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787829977.510213:0:13238:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e9b6fb8a000 00000020:01000000:3.0:1787829977.510242:0:13238:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787829977.510248:0:13238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787829977.510254:0:13238:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787829977.510259:0:13238:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9e9b6fb9b370) has no exports 00000020:00000080:3.0:1787829977.510289:0:13238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787829977.510377:0:13238:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787829977.510444:0:13238:0:(genops.c:885:class_export_put()) final put ffff9e9b51bf9800/OSS_uuid 00000020:00000080:3.0:1787829977.510449:0:13238:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b51bf9800/OSS_uuid for OSS 00000020:01000000:3.0:1787829977.510454:0:13238:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1787829977.510508:0:5801:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787829977.510625:0:6652:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9e9b601ada00:6652] 2 exiting: rc = 0 00000100:00100000:1.0:1787829977.510714:0:8603:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9e9b7f4b2600:8603] 3 exiting: rc = 0 00000100:00100000:2.0:1787829977.510858:0:6650:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9e9b51ff8400:6650] 0 exiting: rc = 1 00000100:00100000:1.0:1787829977.512749:0:6651:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9e9b601aca00:6651] 1 exiting: rc = 0 00000100:00100000:3.0:1787829977.512972:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.512981:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.512996:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513005:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513010:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513562:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513572:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513578:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513583:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513589:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513594:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513599:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513605:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513623:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513628:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513634:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513639:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513644:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513648:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513653:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513658:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513663:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513669:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513674:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513678:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513684:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513689:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513694:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513699:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513704:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513708:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513713:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513717:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513722:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513727:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513732:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513737:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513743:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513748:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513755:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513773:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513779:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513785:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513790:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513795:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513800:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513805:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513810:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513824:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513829:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513835:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513839:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513844:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513850:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513856:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513864:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513870:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513875:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513880:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513885:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513890:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513895:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513901:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.513913:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787829977.514974:0:6654:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9e9b601ad200:6654] 1 exiting: rc = 0 00000100:00100000:0.0:1787829977.515004:0:6653:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9e9b601ac400:6653] 0 exiting: rc = 1 00000100:00100000:3.0:1787829977.515193:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515202:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515207:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515212:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515217:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515221:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515226:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515230:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515236:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515241:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515247:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515251:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515443:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515454:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515459:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515463:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515468:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515473:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515478:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515495:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515500:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515505:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515511:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515516:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515520:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515526:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515530:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515534:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515539:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515545:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515549:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515555:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515560:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515564:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515569:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515574:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515579:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515583:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515588:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515592:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515598:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515603:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515608:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515613:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515618:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515624:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515630:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515635:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515640:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515645:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515650:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515655:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515659:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515664:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515676:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515681:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515687:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515692:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515696:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515701:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515706:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515712:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515716:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.515729:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787829977.517608:0:6656:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9e9b51ec2a00:6656] 1 exiting: rc = 0 00000100:00100000:3.0:1787829977.517624:0:6657:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9e9b4f9d4c00:6657] 2 exiting: rc = 0 00000100:00100000:1.0:1787829977.517758:0:6655:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9e9b6fa06400:6655] 0 exiting: rc = 1 00000100:00100000:3.0:1787829977.518036:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518045:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518050:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518056:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518063:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518070:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518076:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518080:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518084:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518095:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518099:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518103:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518107:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518112:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518117:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518120:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518124:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518128:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518131:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518135:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518138:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518142:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518146:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518150:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518163:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518166:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518169:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518173:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518176:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518179:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518183:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518186:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518190:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518202:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518207:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518210:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518214:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518217:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518220:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518224:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518227:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518244:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518249:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518253:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518262:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518266:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518270:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518275:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518278:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518283:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518294:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518301:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518307:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518312:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518317:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518329:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518346:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518356:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518361:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518370:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518373:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518379:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518384:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.518390:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.525079:0:6658:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9e9b51ec3a00:6658] 0 exiting: rc = 1 00000100:00100000:0.0:1787829977.526135:0:6659:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9e9b51fb1800:6659] 1 exiting: rc = 0 00000100:00100000:3.0:1787829977.526443:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526454:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526458:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526462:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526465:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526468:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526471:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526475:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526478:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526481:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526484:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526487:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526490:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526493:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526496:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526499:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526502:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526505:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526508:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526511:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526514:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526517:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526519:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526522:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526525:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526528:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526531:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526533:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526536:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526548:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526551:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526554:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526558:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526561:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526565:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526569:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526575:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526579:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526582:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526586:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526590:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526594:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526600:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526605:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526609:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526615:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526620:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526624:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526630:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526635:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526641:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526647:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526653:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526658:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526664:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526669:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526674:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526679:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526683:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526688:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526692:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526697:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526702:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.526708:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787829977.528979:0:6660:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9e9b81b5c200:6660] 0 exiting: rc = 1 00000100:00100000:1.0:1787829977.528979:0:6661:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9e9b81b5ca00:6661] 1 exiting: rc = 0 00000100:00100000:3.0:1787829977.529129:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529139:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529146:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529152:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529158:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529163:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529167:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529171:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529176:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529180:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529191:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529197:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529215:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529219:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529226:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529230:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529243:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529248:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529252:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529256:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529262:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529268:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529274:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529280:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529309:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529317:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529323:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529329:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529335:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529341:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529347:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529354:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529359:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529364:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529372:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529467:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529487:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529493:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529499:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529504:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529510:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529515:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529521:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529527:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529535:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529541:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529547:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529552:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529572:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529579:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529586:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529591:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529602:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529608:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529614:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529619:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529625:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529631:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529636:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529642:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529677:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529685:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529691:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787829977.529698:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787829977.546926:0:13238:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1787829994.915448:0:13848:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg151-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787830003.366170:0:14310:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787830003.366175:0:14310:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787830003.366290:0:14310:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e9b44e11000 00000020:01000004:2.0:1787830003.366305:0:14310:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787830003.367206:0:14310:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787830003.367221:0:14310:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9e9b6fb93370) 00000020:00000080:2.0:1787830003.367238:0:14310:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787830003.384218:0:14310:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787830003.389147:0:14310:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1787830003.390227:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 81: rc = 0 00100000:10000000:2.0:1787830003.390734:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 81: rc = 0 00100000:10000000:2.0:1787830003.391792:0:14310:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787830003.391955:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 81: rc = 0 00100000:10000000:2.0:1787830003.392710:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 81: rc = 0 00100000:10000000:2.0:1787830003.392820:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 81: rc = 0 00100000:10000000:3.0:1787830003.400738:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 81: rc = 0 00100000:10000000:3.0:1787830003.401117:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 83: rc = 0 00100000:10000000:3.0:1787830003.402211:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 510: rc = 0 00100000:10000000:3.0:1787830003.402323:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 510: rc = 0 00100000:10000000:3.0:1787830003.402725:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 267: rc = 0 00100000:10000000:3.0:1787830003.403102:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 267: rc = 0 00100000:10000000:3.0:1787830003.407296:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 267: rc = 0 00100000:10000000:2.0:1787830003.411705:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 267: rc = 0 00100000:10000000:2.0:1787830003.412974:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 267: rc = 0 00100000:10000000:2.0:1787830003.413440:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 267: rc = 0 00100000:10000000:2.0:1787830003.413689:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 267: rc = 0 00100000:10000000:2.0:1787830003.415382:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 267: rc = 0 00100000:10000000:2.0:1787830003.415737:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 267: rc = 0 00100000:10000000:2.0:1787830003.416078:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 267: rc = 0 00100000:10000000:2.0:1787830003.416365:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 267: rc = 0 00100000:10000000:2.0:1787830003.416921:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 267: rc = 0 00100000:10000000:2.0:1787830003.417606:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 651: rc = 0 00100000:10000000:2.0:1787830003.417968:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 651: rc = 0 00100000:10000000:2.0:1787830003.418249:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 651: rc = 0 00100000:10000000:2.0:1787830003.418639:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 651: rc = 0 00100000:10000000:2.0:1787830003.418958:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 651: rc = 0 00100000:10000000:2.0:1787830003.419359:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 651: rc = 0 00100000:10000000:2.0:1787830003.419728:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 651: rc = 0 00100000:10000000:2.0:1787830003.420095:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 651: rc = 0 00100000:10000000:2.0:1787830003.420368:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 651: rc = 0 00100000:10000000:2.0:1787830003.421140:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 651: rc = 0 00100000:10000000:2.0:1787830003.421407:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 651: rc = 0 00100000:10000000:2.0:1787830003.421686:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 651: rc = 0 00100000:10000000:2.0:1787830003.422102:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 651: rc = 0 00100000:10000000:2.0:1787830003.422378:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 651: rc = 0 00100000:10000000:2.0:1787830003.422640:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 651: rc = 0 00100000:10000000:2.0:1787830003.423727:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 651: rc = 0 00100000:10000000:2.0:1787830003.425373:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 651: rc = 0 00100000:10000000:2.0:1787830003.425687:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 651: rc = 0 00100000:10000000:2.0:1787830003.429623:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 651: rc = 0 00100000:10000000:2.0:1787830003.430061:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 651: rc = 0 00100000:10000000:2.0:1787830003.430300:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 651: rc = 0 00100000:10000000:2.0:1787830003.430564:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 651: rc = 0 00100000:10000000:2.0:1787830003.430826:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 651: rc = 0 00100000:10000000:2.0:1787830003.431091:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 651: rc = 0 00100000:10000000:2.0:1787830003.431342:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 651: rc = 0 00100000:10000000:2.0:1787830003.431601:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 651: rc = 0 00100000:10000000:2.0:1787830003.431842:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 651: rc = 0 00100000:10000000:2.0:1787830003.432131:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 651: rc = 0 00100000:10000000:2.0:1787830003.435039:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 651: rc = 0 00100000:10000000:2.0:1787830003.435883:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 651: rc = 0 00100000:10000000:2.0:1787830003.436197:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 651: rc = 0 00100000:10000000:2.0:1787830003.436485:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 651: rc = 0 00100000:10000000:2.0:1787830003.436827:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 645: rc = 0 00100000:10000000:2.0:1787830003.437353:0:14310:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1787830003.437505:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:2.0:1787830003.437686:0:14310:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1787830003.437749:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:2.0:1787830003.437940:0:14310:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1787830003.438005:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:2.0:1787830003.441369:0:14310:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1787830003.441460:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 511: rc = 0 00100000:10000000:2.0:1787830003.442059:0:14310:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1787830003.442130:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 511: rc = 0 00100000:10000000:2.0:1787830003.442333:0:14310:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1787830003.442401:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 511: rc = 0 00000020:00000080:3.0:1787830003.443001:0:14310:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787830003.443011:0:14310:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787830003.443040:0:14310:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc03b4d103c0d880f 00000020:01000004:3.0:1787830003.443048:0:14310:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787830003.443053:0:14310:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787830003.443059:0:14310:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e9b44e11000 from MGS 00000020:01000004:3.0:1787830003.443063:0:14310:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787830003.443073:0:14310:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9e9b7f584d28) 00000020:00000080:3.0:1787830003.443083:0:14310:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787830003.443135:0:14310:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e9b44e11000 from MGS, refs=2 00080000:01000000:3.0:1787830003.443140:0:14310:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787830003.443145:0:14310:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc03b4d103c0d881d 00000100:00100000:3.0:1787830003.443236:0:14310:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787830003.443383:0:14310:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787830003.443389:0:14310:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787830003.444442:0:14310:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787830003.444450:0:14310:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787830003.445459:0:14310:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787830003.445645:0:14310:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787830003.445651:0:14310:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787830003.446283:0:14310:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787830003.446290:0:14310:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787830003.446582:0:14310:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787830003.446588:0:14310:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787830003.447357:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830003.447361:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830003.447363:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830003.447615:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830003.447617:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830003.447619:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830003.448183:0:14310:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787830003.453788:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787830003.480303:0:14310:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787830003.480335:0:14310:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787830003.480339:0:14310:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787830003.489727:0:14319:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787830003.490132:0:14310:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787830003.490257:0:14310:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787830003.496967:0:14310:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787830003.497361:0:14310:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787830003.497541:0:14310:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787830003.497548:0:14310:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787830003.504620:0:14310:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787830003.504636:0:14310:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787830003.505177:0:14310:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787830003.505184:0:14310:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787830003.505885:0:14310:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787830003.505908:0:14310:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.151@tcp' 00000020:01000004:0.0:1787830003.505910:0:14310:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787830003.506094:0:14310:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.151@tcp (typ=mgc) 00000020:00000080:0.0:1787830003.506106:0:14310:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.151@tcp (ffff9e9b74bf3370) 00000020:00000080:0.0:1787830003.506121:0:14310:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787830003.506205:0:14310:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e9b51bfd000@MGC192.168.201.151@tcp: add connection 192.168.201.151@tcp at head 00010000:00010000:0.0:1787830003.506378:0:14310:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.151@tcp-0 is initialized 00000040:01000000:0.0:1787830003.506384:0:14310:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.151@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787830003.506519:0:14324:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1787830003.509112:0:14325:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787830003.509456:0:14310:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.151@tcp (uuid defee3f2-32c0-45d9-9a5f-ef73e4ad629c) 00000020:00000080:3.0:1787830003.509493:0:14310:0:(genops.c:1385:class_connect()) connect: client defee3f2-32c0-45d9-9a5f-ef73e4ad629c, cookie 0xc03b4d103c0d882b 00000100:00080000:3.0:1787830003.509507:0:14310:0:(import.c:510:import_select_connection()) MGC192.168.201.151@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787830003.509514:0:14310:0:(import.c:624:import_select_connection()) MGC192.168.201.151@tcp: import ffff9e9b51bfd000 using connection 192.168.201.151@tcp/0@lo 00000100:00100000:3.0:1787830003.509551:0:14310:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b7f998f00 x1874675284136064/t0(0) o250->MGC192.168.201.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787830003.509591:0:14310:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import defee3f2-32c0-45d9-9a5f-ef73e4ad629c->MGS 00000020:01000004:3.0:1787830003.509615:0:14310:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787830003.509620:0:14310:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787830003.509634:0:14310:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9e9b7f583370) 00000020:00000080:3.0:1787830003.509646:0:14310:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787830003.511700:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f998f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3277:1874675284136064:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787830003.511784:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830003.512043:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284136064 00000100:00100000:1.0:1787830003.512053:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284136064 00000100:00100000:1.0:1787830003.512090:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787830003.512099:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3277:x1874675284136064:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1787830003.512132:0:14321:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from defee3f2-32c0-45d9-9a5f-ef73e4ad629c@0@lo t0 exp 0000000000000000 cur 383 last 0 00000020:00000080:1.0:1787830003.512167:0:14321:0:(genops.c:1385:class_connect()) connect: client defee3f2-32c0-45d9-9a5f-ef73e4ad629c, cookie 0xc03b4d103c0d8839 00000100:00080000:1.0:1787830003.512304:0:14321:0:(import.c:65:import_set_state_nolock()) ffff9e9b81c35000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787830003.512372:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+5:3277:x1874675284136064:12345-0@lo:250:mount.lustre.0 Request processed in 272us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830003.512380:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787830003.512982:0:3277:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.151@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787830003.512992:0:3277:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.151@tcp: connect to target with instance 0 00000100:00080000:0.0:1787830003.513000:0:3277:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787830003.513005:0:3277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787830003.513009:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9e9b51bfd000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787830003.513012:0:3277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787830003.513044:0:3277:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787830003.513051:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f998f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3277:1874675284136064:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787830003.521136:0:14310:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787830003.531639:0:14310:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787830003.531652:0:14310:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787830003.538647:0:14310:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787830003.538665:0:14310:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787830003.542611:0:14310:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787830003.542626:0:14310:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787830003.543502:0:14310:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787830003.543688:0:14310:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787830003.543693:0:14310:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787830003.546157:0:14310:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787830003.546169:0:14310:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787830003.627871:0:14310:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787830003.628191:0:14310:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787830003.628199:0:14310:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787830003.634005:0:14310:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787830003.634047:0:14310:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787830003.637277:0:14310:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787830003.637515:0:14310:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787830003.637522:0:14310:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787830003.638259:0:14310:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787830003.638267:0:14310:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787830003.639141:0:14310:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787830003.639297:0:14310:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787830003.639315:0:14310:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787830003.642913:0:14310:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787830003.642925:0:14310:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787830003.645939:0:14310:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787830003.646378:0:14310:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787830003.646385:0:14310:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787830003.648531:0:14310:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787830003.648543:0:14310:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787830003.693040:0:14310:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787830003.693268:0:14310:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787830003.693275:0:14310:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787830003.701690:0:14310:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787830003.701706:0:14310:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787830003.702853:0:14310:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787830003.702862:0:14310:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787830003.705069:0:14310:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787830003.705096:0:14310:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787830003.705103:0:14310:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787830003.705257:0:14310:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.151@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787830003.705297:0:14310:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.151@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787830003.705313:0:14310:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787830003.705314:0:14310:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787830003.705316:0:14310:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787830003.705318:0:14310:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787830003.705319:0:14310:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787830003.705320:0:14310:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787830003.705322:0:14310:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787830003.705323:0:14310:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787830003.705325:0:14310:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787830003.705327:0:14310:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787830003.705330:0:14310:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787830003.705332:0:14310:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787830003.705338:0:14310:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787830003.705339:0:14310:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787830003.705340:0:14310:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787830003.705341:0:14310:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787830003.705342:0:14310:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787830003.705343:0:14310:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787830003.705343:0:14310:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787830003.705344:0:14310:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787830003.705345:0:14310:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787830003.705382:0:14310:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787830003.705402:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3cc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284136192:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787830003.705473:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830003.705523:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4561fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830003.705617:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284136192 00000100:00100000:0.0:1787830003.705624:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284136192 00000100:00100000:0.0:1787830003.705659:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787830003.705668:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+5:14310:x1874675284136192:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787830003.705719:0:14323:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787830003.705722:0:14323:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787830003.705725:0:14323:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1787830003.706747:0:14344:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787830003.724863:0:14323:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1787830003.726543:0:14345:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787830003.726552:0:14345:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787830003.726556:0:14345:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787830003.726592:0:14345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1787830003.727663:0:14323:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787830003.727677:0:14323:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787830003.746553:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+5:14310:x1874675284136192:12345-0@lo:253:mount.lustre.0 Request processed in 40876us (41069us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830003.746575:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787830003.746706:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3cc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284136192:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787830003.746723:0:14310:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787830003.746727:0:14310:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787830003.746728:0:14310:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787830003.746729:0:14310:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787830003.746731:0:14310:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787830003.746732:0:14310:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787830003.746733:0:14310:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787830003.746735:0:14310:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787830003.746737:0:14310:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787830003.746739:0:14310:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787830003.746740:0:14310:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787830003.746761:0:14310:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e9b44e11000 from lustre-MDT0000 10000000:01000000:1.0:1787830003.746791:0:14310:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787830003.746794:0:14310:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787830003.746799:0:14310:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9e9b74bf3370 10000000:01000000:1.0:1787830003.746803:0:14310:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787830003.746813:0:14310:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e9b74bf3370 from 1 10000000:01000000:1.0:1787830003.746829:0:14310:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787830003.746871:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b7feefe00/0xc03b4d103c0d8840 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830003.746882:0:14310:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b7feefe00/0xc03b4d103c0d8840 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830003.746892:0:14310:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b7feefe00/0xc03b4d103c0d8840 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830003.746916:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbefc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284136320:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787830003.746959:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830003.747006:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51f21600 going to sleep for 11 seconds 00000100:00100000:0.0:1787830003.747161:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284136320 00000100:00100000:0.0:1787830003.747177:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284136320 00000100:00100000:0.0:1787830003.747279:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787830003.747293:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+5:14310:x1874675284136320:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787830003.747327:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830003.747369:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8847 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d8840 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830003.747410:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d8840 expref: 6 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830003.747428:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b7fa7fc00/0xc03b4d103c0d8847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d8840 expref: 6 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830003.747441:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7fa7fc00, rc 0) 00000100:00100000:0.0:1787830003.747527:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+6:14310:x1874675284136320:12345-0@lo:101:mount.lustre.0 Request processed in 238us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830003.747535:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787830003.747782:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbefc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284136320:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787830003.747806:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b7feefe00/0xc03b4d103c0d8840 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8847 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830003.747818:0:14310:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b7feefe00/0xc03b4d103c0d8840 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d8847 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830003.747882:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbefc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284136448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787830003.747917:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830003.748114:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51f21600 going to sleep for 11 seconds 00000100:00100000:2.0:1787830003.753957:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284136448 00000100:00100000:2.0:1787830003.753974:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284136448 00000100:00100000:2.0:1787830003.754059:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787830003.754070:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+6:14310:x1874675284136448:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787830003.754574:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+6:14310:x1874675284136448:12345-0@lo:501:mount.lustre.0 Request processed in 505us (6654us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787830003.754583:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787830003.766983:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbefc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284136448:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787830003.767283:0:14310:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787830003.767298:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b7feefe00/0xc03b4d103c0d8840 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8847 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830003.767318:0:14310:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b7feefe00/0xc03b4d103c0d8840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8847 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830003.767327:0:14310:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e9b44e11000 10000000:01000000:0.0:1787830003.767335:0:14310:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787830003.767340:0:14310:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e9b44e11000 10000000:01000000:0.0:1787830003.767344:0:14310:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787830003.767346:0:14310:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9e9b44e11000 from 1 10000000:01000000:0.0:1787830003.767349:0:14310:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787830003.767405:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7e600/0xc03b4d103c0d884e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830003.767412:0:14310:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7e600/0xc03b4d103c0d884e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830003.767423:0:14310:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7e600/0xc03b4d103c0d884e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830003.767443:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f313840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284136576:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787830003.767514:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830003.767563:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51e6e480 going to sleep for 11 seconds 00000100:00100000:3.0:1787830003.768070:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284136576 00000100:00100000:3.0:1787830003.768086:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284136576 00000100:00100000:3.0:1787830003.768159:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787830003.768171:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+6:14310:x1874675284136576:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787830003.768192:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830003.768220:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b74898800/0xc03b4d103c0d8855 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d884e expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830003.768253:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b74898800/0xc03b4d103c0d8855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d884e expref: 7 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830003.768267:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b74898800/0xc03b4d103c0d8855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d884e expref: 7 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830003.768277:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74898800, rc 0) 00000100:00100000:3.0:1787830003.768390:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+7:14310:x1874675284136576:12345-0@lo:101:mount.lustre.0 Request processed in 221us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830003.768398:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787830003.768630:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f313840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284136576:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787830003.768651:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7e600/0xc03b4d103c0d884e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8855 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830003.768679:0:14310:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7e600/0xc03b4d103c0d884e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d8855 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830003.768706:0:14310:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787830003.768712:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7e600/0xc03b4d103c0d884e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8855 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830003.768718:0:14310:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7e600/0xc03b4d103c0d884e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8855 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830003.768726:0:14310:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787830003.768732:0:14310:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787830003.768738:0:14310:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e9b44e11000 10000000:01000000:2.0:1787830003.768741:0:14310:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787830003.768744:0:14310:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787830003.768747:0:14310:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787830003.768784:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3f000/0xc03b4d103c0d885c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830003.768793:0:14310:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3f000/0xc03b4d103c0d885c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830003.768802:0:14310:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3f000/0xc03b4d103c0d885c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830003.768822:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3ce580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284136704:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787830003.768860:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830003.768899:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4561f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830003.769043:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284136704 00000100:00100000:3.0:1787830003.769055:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284136704 00000100:00100000:3.0:1787830003.769099:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787830003.769107:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+7:14310:x1874675284136704:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787830003.769117:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830003.769128:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b74899600/0xc03b4d103c0d8863 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d885c expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830003.769146:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b74899600/0xc03b4d103c0d8863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d885c expref: 8 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830003.769156:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b74899600/0xc03b4d103c0d8863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d885c expref: 8 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830003.769164:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74899600, rc 0) 00000100:00100000:3.0:1787830003.769197:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+8:14310:x1874675284136704:12345-0@lo:101:mount.lustre.0 Request processed in 91us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830003.769203:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787830003.770556:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3ce580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284136704:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787830003.770589:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3f000/0xc03b4d103c0d885c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8863 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830003.770603:0:14310:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3f000/0xc03b4d103c0d885c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d8863 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830003.770701:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3ce580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284136832:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787830003.770785:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830003.770836:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4561f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830003.771498:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284136832 00000100:00100000:3.0:1787830003.771509:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284136832 00000100:00100000:2.0:1787830003.772531:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787830003.772552:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+8:14310:x1874675284136832:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787830003.775201:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+9:14310:x1874675284136832:12345-0@lo:501:mount.lustre.0 Request processed in 2647us (4405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830003.775217:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787830003.775345:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3ce580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284136832:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787830003.775408:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f311680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284136960:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787830003.775472:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830003.775514:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51e6e840 going to sleep for 11 seconds 00000100:00100000:1.0:1787830003.775575:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284136960 00000100:00100000:1.0:1787830003.775583:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284136960 00000100:00100000:1.0:1787830003.775635:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787830003.775645:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+9:14310:x1874675284136960:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787830003.776003:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+9:14310:x1874675284136960:12345-0@lo:503:mount.lustre.0 Request processed in 360us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830003.776011:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787830003.776142:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f311680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284136960:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787830003.776663:0:14346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f311680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14346:1874675284137088:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787830003.776711:0:14346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830003.776746:0:14346:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51e6e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830003.776795:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284137088 00000100:00100000:2.0:1787830003.776801:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284137088 00000100:00100000:2.0:1787830003.776836:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787830003.776844:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+9:14346:x1874675284137088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787830003.777127:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+9:14346:x1874675284137088:12345-0@lo:502:llog_process_th.0 Request processed in 283us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830003.777135:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787830003.777232:0:14346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f311680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14346:1874675284137088:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787830003.777256:0:14346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787830003.777268:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830003.777270:0:14346:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787830003.777275:0:14346:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787830003.777278:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787830003.777293:0:14346:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9e9b74bf19b8) 00000020:00000080:0.0:1787830003.777331:0:14346:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787830003.777342:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787830003.777412:0:14346:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787830003.777420:0:14346:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc03b4d103c0d8871 00000020:00000080:0.0:1787830003.777641:0:14346:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787830003.777645:0:14346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787830003.777649:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830003.777650:0:14346:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787830003.777653:0:14346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787830003.777656:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830003.777658:0:14346:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787830003.777661:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787830003.777668:0:14346:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9e9b74bf0000) 00000020:00000080:0.0:1787830003.777678:0:14346:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787830003.777682:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787830003.777684:0:14346:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787830003.777686:0:14346:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787830003.777692:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787830003.777748:0:14346:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e9b44e11000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787830003.777764:0:14346:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9e9b74bf4d28) 00000020:00000080:0.0:1787830003.777772:0:14346:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787830003.777810:0:14346:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787830003.777822:0:14346:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc03b4d103c0d8886 00000020:00000080:0.0:1787830003.777911:0:14346:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787830003.777918:0:14346:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787830003.777923:0:14346:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc03b4d103c0d888d 00080000:01000000:0.0:1787830003.777928:0:14346:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787830003.777932:0:14346:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc03b4d103c0d8894 00010000:00010000:1.0:1787830003.984717:0:14346:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1787830003.989513:0:14346:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:1.0:1787830003.989799:0:14346:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787830003.994960:0:14346:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9e9b6fb919b8) 00000020:00000080:2.0:1787830003.994985:0:14346:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787830003.995093:0:14346:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787830003.995101:0:14346:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc03b4d103c0d88a2 00000020:00000080:0.0:1787830004.004767:0:14346:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787830004.017106:0:14346:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc03b4d103c0d88a9 00000020:00000080:2.0:1787830004.018106:0:14346:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787830004.018140:0:14346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787830004.018147:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830004.018149:0:14346:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787830004.018153:0:14346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787830004.018155:0:14346:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1787830004.018156:0:14346:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787830004.018158:0:14346:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787830004.018159:0:14346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787830004.018162:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830004.018163:0:14346:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787830004.018166:0:14346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787830004.018170:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830004.018172:0:14346:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787830004.018176:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787830004.018217:0:14346:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787830004.018230:0:14346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787830004.018232:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830004.018234:0:14346:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787830004.018236:0:14346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787830004.018240:0:14346:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787830004.018243:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830004.018245:0:14346:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787830004.018247:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787830004.018253:0:14346:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.151@tcp to nid 0x20000c0a8c997 (192.168.201.151@tcp) 00000020:01000000:2.0:1787830004.018275:0:14346:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787830004.018278:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787830004.018290:0:14346:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e9b6fb90000) 00000020:00000080:2.0:1787830004.018314:0:14346:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787830004.018318:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787830004.018379:0:14346:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787830004.018384:0:14346:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787830004.018389:0:14346:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc03b4d103c0d88b7 00010000:00080000:2.0:1787830004.018425:0:14346:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e9b4f86a000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.151@tcp at head 00010000:00010000:2.0:1787830004.018646:0:14346:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1787830004.019009:0:14346:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787830004.019078:0:14346:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787830004.019963:0:14346:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787830004.020059:0:14346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1787830004.020143:0:14346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1787830004.029406:0:14350:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787830004.029418:0:14350:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787830004.030515:0:14346:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787830004.030533:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787830004.030571:0:14346:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787830004.030593:0:14346:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc03b4d103c0d88be 00000100:00080000:2.0:1787830004.030605:0:14346:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787830004.030612:0:14346:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e9b4f86a000 using connection 192.168.201.151@tcp/0@lo 00000100:00100000:2.0:1787830004.030651:0:14346:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b7f3ccf00 x1874675284137216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787830004.030678:0:14346:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787830004.030745:0:14346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787830004.030750:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830004.030751:0:14346:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787830004.030754:0:14346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787830004.030757:0:14346:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787830004.030759:0:14346:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787830004.030760:0:14346:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787830004.030762:0:14346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787830004.030764:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830004.030766:0:14346:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787830004.030768:0:14346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787830004.030773:0:14346:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787830004.030776:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830004.030777:0:14346:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787830004.030781:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787830004.030784:0:14346:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.151@tcp to nid 0x20000c0a8c997 (192.168.201.151@tcp) 00000020:01000000:2.0:1787830004.030809:0:14346:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787830004.030825:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787830004.030839:0:14346:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e9b6fb94d28) 00000020:00000080:2.0:1787830004.030851:0:14346:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787830004.030857:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787830004.030926:0:14346:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787830004.030933:0:14346:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787830004.030939:0:14346:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc03b4d103c0d88cc 00010000:00080000:2.0:1787830004.030968:0:14346:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e9b4f86f000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.151@tcp at head 00010000:00010000:2.0:1787830004.031215:0:14346:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1787830004.031435:0:14346:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787830004.031459:0:14346:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1787830004.031487:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1874675284137216:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787830004.031549:0:3277:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874675284137216 offset 0 length 520: 4 00000040:00080000:2.0:1787830004.032120:0:14346:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787830004.032195:0:14346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1787830004.032279:0:14346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1787830004.046667:0:14352:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787830004.046677:0:14352:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787830004.050924:0:14346:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787830004.050940:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787830004.050980:0:14346:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787830004.051000:0:14346:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc03b4d103c0d88d3 00000100:00080000:3.0:1787830004.051012:0:14346:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787830004.051050:0:14346:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e9b4f86f000 using connection 192.168.201.151@tcp/0@lo 00000100:00100000:3.0:1787830004.051088:0:14346:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b7f9983c0 x1874675284137344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787830004.051133:0:14346:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787830004.051188:0:14346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787830004.051193:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830004.051195:0:14346:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787830004.051198:0:14346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787830004.051202:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830004.051204:0:14346:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787830004.051207:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787830004.051209:0:14346:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787830004.051211:0:14346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787830004.051214:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830004.051215:0:14346:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787830004.051217:0:14346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787830004.051219:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830004.051221:0:14346:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787830004.051225:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787830004.051258:0:14346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14346:1874675284137472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830004.051352:0:14346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830004.051353:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f9983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1874675284137344:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787830004.051383:0:3277:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874675284137344 offset 0 length 520: 4 00000100:00100000:3.0:1787830004.051390:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284137472 00000100:00100000:3.0:1787830004.051396:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284137472 00000100:00100000:3.0:1787830004.051430:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787830004.051451:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+9:14346:x1874675284137472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830004.051690:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+9:14346:x1874675284137472:12345-0@lo:502:llog_process_th.0 Request processed in 251us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830004.051698:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787830004.051736:0:14346:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b75d9c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787830004.051756:0:14346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14346:1874675284137472:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787830004.051780:0:14346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787830004.051789:0:14346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830004.051791:0:14346:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787830004.051795:0:14346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787830004.051986:0:14310:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1787830004.052006:0:14310:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787830004.052048:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3f000/0xc03b4d103c0d885c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8863 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830004.052060:0:14310:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3f000/0xc03b4d103c0d885c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8863 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830004.052068:0:14310:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e9b44e11000 from 1 10000000:01000000:0.0:1787830004.052070:0:14310:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787830004.052098:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7f600/0xc03b4d103c0d88da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830004.052105:0:14310:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7f600/0xc03b4d103c0d88da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830004.052114:0:14310:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7f600/0xc03b4d103c0d88da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830004.052127:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f311680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284137600:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787830004.052157:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830004.052186:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51e6e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830004.052204:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284137600 00000100:00100000:2.0:1787830004.052209:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284137600 00000100:00100000:2.0:1787830004.052244:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787830004.052252:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+9:14310:x1874675284137600:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787830004.052262:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830004.052276:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b74e3e600/0xc03b4d103c0d88e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d88da expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830004.052309:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b74e3e600/0xc03b4d103c0d88e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d88da expref: 10 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830004.052320:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b74e3e600/0xc03b4d103c0d88e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d88da expref: 10 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830004.052328:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3e600, rc 0) 00000100:00100000:2.0:1787830004.052368:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+10:14310:x1874675284137600:12345-0@lo:101:mount.lustre.0 Request processed in 116us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830004.052381:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787830004.052388:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f311680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284137600:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787830004.052400:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7f600/0xc03b4d103c0d88da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d88e1 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830004.052414:0:14310:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7f600/0xc03b4d103c0d88da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d88e1 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830004.052983:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f311680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284137728:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787830004.053093:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830004.053110:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51e6e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830004.053547:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284137728 00000100:00100000:3.0:1787830004.053554:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284137728 00000100:00100000:3.0:1787830004.053585:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787830004.053592:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+10:14310:x1874675284137728:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787830004.053618:0:14321:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787830004.053625:0:14321:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787830004.053699:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+10:14310:x1874675284137728:12345-0@lo:256:mount.lustre.0 Request processed in 108us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830004.053706:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787830004.053833:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f311680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284137728:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787830004.054455:0:14310:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787830004.054476:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7f600/0xc03b4d103c0d88da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d88e1 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830004.054486:0:14310:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7f600/0xc03b4d103c0d88da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d88e1 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830004.054494:0:14310:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9b44e11000 from 1 10000000:01000000:2.0:1787830004.054497:0:14310:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787830004.054526:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ec00/0xc03b4d103c0d88e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830004.054534:0:14310:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ec00/0xc03b4d103c0d88e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830004.054543:0:14310:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ec00/0xc03b4d103c0d88e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830004.054560:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3cfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284137856:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787830004.054603:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830004.054654:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b69e3c900 going to sleep for 11 seconds 00000100:00100000:1.0:1787830004.054658:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284137856 00000100:00100000:1.0:1787830004.054663:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284137856 00000100:00100000:1.0:1787830004.054696:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787830004.054703:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+10:14310:x1874675284137856:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787830004.054713:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830004.054728:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d88ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d88e8 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830004.054749:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d88ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d88e8 expref: 11 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830004.054759:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d88ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d88e8 expref: 11 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830004.054767:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feef800, rc 0) 00000100:00100000:1.0:1787830004.054809:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+11:14310:x1874675284137856:12345-0@lo:101:mount.lustre.0 Request processed in 106us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830004.054815:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787830004.054910:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3cfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284137856:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787830004.054922:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ec00/0xc03b4d103c0d88e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d88ef expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830004.054929:0:14310:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ec00/0xc03b4d103c0d88e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d88ef expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830004.054985:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3cfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284137984:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787830004.055012:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830004.055055:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b69e3c900 going to sleep for 11 seconds 00000100:00100000:1.0:1787830004.055177:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284137984 00000100:00100000:1.0:1787830004.055182:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284137984 00000100:00100000:1.0:1787830004.055210:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787830004.055217:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+11:14310:x1874675284137984:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787830004.055631:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+11:14310:x1874675284137984:12345-0@lo:501:mount.lustre.0 Request processed in 412us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830004.055638:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787830004.055713:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3cfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284137984:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787830004.055747:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3121c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284138112:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787830004.055791:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830004.055814:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51e6e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830004.055864:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284138112 00000100:00100000:3.0:1787830004.055868:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284138112 00000100:00100000:3.0:1787830004.055900:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787830004.055908:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7b5cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+11:14310:x1874675284138112:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787830004.056078:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7b5cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+11:14310:x1874675284138112:12345-0@lo:503:mount.lustre.0 Request processed in 171us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830004.056085:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787830004.056157:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3121c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284138112:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787830004.057922:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3121c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14354:1874675284138240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787830004.057997:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830004.058073:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51e6e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787830004.058198:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284138240 00000100:00100000:1.0:1787830004.058203:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284138240 00000100:00100000:1.0:1787830004.058238:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787830004.058246:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7b5c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+11:14354:x1874675284138240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787830004.058505:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7b5c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+11:14354:x1874675284138240:12345-0@lo:502:llog_process_th.0 Request processed in 259us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830004.058514:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787830004.059103:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3121c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14354:1874675284138240:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787830004.059136:0:14354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787830004.059146:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830004.059148:0:14354:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787830004.059154:0:14354:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e9b44e11000 00000020:00000080:0.0:1787830004.059157:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787830004.059165:0:14354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787830004.059167:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830004.059168:0:14354:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787830004.059170:0:14354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787830004.059173:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830004.059182:0:14354:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787830004.059188:0:14354:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e9b44e11000 00000020:00000080:0.0:1787830004.059189:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787830004.059308:0:14354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787830004.059312:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830004.059313:0:14354:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787830004.059315:0:14354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787830004.059318:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830004.059320:0:14354:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787830004.059323:0:14354:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e9b44e11000 00000020:00000080:0.0:1787830004.059324:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787830004.066077:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3121c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14354:1874675284138368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787830004.066168:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830004.066216:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51e6e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830004.066340:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284138368 00000100:00100000:3.0:1787830004.066348:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284138368 00000100:00100000:3.0:1787830004.066404:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787830004.066414:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7b5c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+11:14354:x1874675284138368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830004.066667:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7b5c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+11:14354:x1874675284138368:12345-0@lo:502:llog_process_th.0 Request processed in 253us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830004.066675:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787830004.066719:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3121c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14354:1874675284138368:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787830004.066757:0:14354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787830004.066765:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830004.066767:0:14354:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787830004.066771:0:14354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787830004.066876:0:14310:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787830004.066895:0:14310:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787830004.066921:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ec00/0xc03b4d103c0d88e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d88ef expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830004.066931:0:14310:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ec00/0xc03b4d103c0d88e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d88ef expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830004.066973:0:14310:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787830004.066976:0:14310:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e9b44e11000 10000000:01000000:3.0:1787830004.066979:0:14310:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e9b44e11000 10000000:01000000:3.0:1787830004.066983:0:14310:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787830004.066988:0:14310:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e9b44e11000 from 1 10000000:01000000:3.0:1787830004.066990:0:14310:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787830004.067043:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74898200/0xc03b4d103c0d88f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830004.067050:0:14310:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b74898200/0xc03b4d103c0d88f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830004.067059:0:14310:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b74898200/0xc03b4d103c0d88f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830004.067072:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284138496:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787830004.067101:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830004.067124:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51f21000 going to sleep for 11 seconds 00000100:00100000:3.0:1787830004.069989:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284138496 00000100:00100000:3.0:1787830004.070003:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284138496 00000100:00100000:3.0:1787830004.070069:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787830004.070079:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7b5c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+11:14310:x1874675284138496:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787830004.070099:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830004.070121:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b74899c00/0xc03b4d103c0d88fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d88f6 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830004.070159:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b74899c00/0xc03b4d103c0d88fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d88f6 expref: 12 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830004.070171:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b74899c00/0xc03b4d103c0d88fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d88f6 expref: 12 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830004.070180:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74899c00, rc 0) 00000100:00100000:3.0:1787830004.070254:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7b5c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:14310:x1874675284138496:12345-0@lo:101:mount.lustre.0 Request processed in 177us (3152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830004.070262:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787830004.070343:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284138496:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787830004.070363:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b74898200/0xc03b4d103c0d88f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d88fd expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830004.070373:0:14310:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b74898200/0xc03b4d103c0d88f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d88fd expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830004.070458:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284138624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787830004.070491:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830004.070519:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47a4cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787830004.072515:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284138624 00000100:00100000:1.0:1787830004.072526:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284138624 00000100:00100000:1.0:1787830004.072579:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787830004.072589:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7b5ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:14310:x1874675284138624:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787830004.072857:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7b5ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:14310:x1874675284138624:12345-0@lo:501:mount.lustre.0 Request processed in 269us (2364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830004.072866:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787830004.074659:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284138624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787830004.074726:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284138752:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787830004.074795:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830004.074826:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47a4cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787830004.074843:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284138752 00000100:00100000:3.0:1787830004.074853:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284138752 00000100:00100000:3.0:1787830004.074890:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787830004.074898:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7b5c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:14310:x1874675284138752:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787830004.075076:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7b5c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:14310:x1874675284138752:12345-0@lo:503:mount.lustre.0 Request processed in 177us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830004.075083:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787830004.075127:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284138752:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787830004.080208:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14357:1874675284138880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830004.080311:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830004.080352:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284138880 00000100:00100000:3.0:1787830004.080358:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284138880 00000100:00100000:3.0:1787830004.080401:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787830004.080409:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7b5c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:14357:x1874675284138880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830004.080784:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7b5c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:14357:x1874675284138880:12345-0@lo:502:llog_process_th.0 Request processed in 374us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830004.080792:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787830004.080841:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47a4cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787830004.080862:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14357:1874675284138880:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787830004.080920:0:14357:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787830004.080935:0:14357:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9e9b7f5819b8) 00000020:00000080:3.0:1787830004.080952:0:14357:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1787830004.081044:0:14357:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e9b44e11000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787830004.081048:0:14357:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e9b44e11000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787830004.081051:0:14357:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e9b44e11000 4 00010000:00080000:3.0:1787830004.081086:0:14357:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e9b48ec8000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.151@tcp at head 00010000:00010000:3.0:1787830004.090233:0:14357:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1787830004.093785:0:14357:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787830004.093823:0:14357:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787830004.093837:0:14357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc03b4d103c0d890b 00000100:00080000:3.0:1787830004.093849:0:14357:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787830004.093856:0:14357:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e9b48ec8000 using connection 192.168.201.151@tcp/0@lo 00000100:00100000:3.0:1787830004.093922:0:14357:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b7f999680 x1874675284139008/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787830004.093974:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1874675284139008:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787830004.094063:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830004.094144:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284139008 00000100:00100000:3.0:1787830004.094151:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284139008 00000100:00100000:3.0:1787830004.094192:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787830004.094200:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f99a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1874675284139008:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787830004.094251:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f99a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1874675284139008:12345-0@lo:38:llog_process_th.0 Request processed in 50us (187us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787830004.094258:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787830004.094290:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787830004.094311:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9e9b48ec8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787830004.094333:0:3277:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787830004.094337:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1874675284139008:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787830004.094357:0:14357:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787830004.105719:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3121c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14357:1874675284139136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787830004.105808:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830004.105846:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b54292840 going to sleep for 11 seconds 00000100:00100000:0.0:1787830004.105869:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284139136 00000100:00100000:0.0:1787830004.105874:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284139136 00000100:00100000:0.0:1787830004.105910:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787830004.105918:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7b5c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:14357:x1874675284139136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787830004.106169:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7b5c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:14357:x1874675284139136:12345-0@lo:502:llog_process_th.0 Request processed in 251us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830004.106177:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787830004.106232:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3121c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14357:1874675284139136:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787830004.106258:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787830004.108567:0:14310:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787830004.108603:0:14310:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787830004.108621:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74898200/0xc03b4d103c0d88f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d88fd expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830004.108635:0:14310:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b74898200/0xc03b4d103c0d88f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d88fd expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787830004.108690:0:14310:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787830004.108693:0:14310:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787830004.108694:0:14310:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787830004.108695:0:14310:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787830004.108697:0:14310:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787830004.108699:0:14310:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787830004.108700:0:14310:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787830004.108702:0:14310:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787830004.108704:0:14310:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787830004.108706:0:14310:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787830004.108709:0:14310:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1787830004.108712:0:14310:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787830004.108714:0:14310:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787830004.108715:0:14310:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787830004.108716:0:14310:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787830004.108717:0:14310:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787830004.108718:0:14310:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787830004.108719:0:14310:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787830004.108720:0:14310:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787830004.108721:0:14310:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787830004.108722:0:14310:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787830004.108749:0:14310:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787830004.108768:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284139264:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787830004.108838:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830004.108873:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47a4c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830004.109400:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284139264 00000100:00100000:0.0:1787830004.109409:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284139264 00000100:00100000:0.0:1787830004.109454:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787830004.109464:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7b5cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:14310:x1874675284139264:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787830004.110761:0:14322:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787830004.110777:0:14322:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787830004.209003:0:14322:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787830004.209048:0:14322:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787830004.209269:0:14344:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787830004.209275:0:14344:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787830004.209306:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e9b74898a00/0xc03b4d103c0d8912 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830004.209327:0:14344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b74e3e600/0xc03b4d103c0d88e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d88da expref: 12 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830004.209336:0:14344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e9b74898a00/0xc03b4d103c0d8912 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830004.209391:0:14344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b74e3e600/0xc03b4d103c0d88e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d88da expref: 12 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830004.209405:0:14344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9b74e3e600/0xc03b4d103c0d88e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d88da expref: 12 pid: 14322 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830004.209420:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f99bc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14344:1874675284139392:0@lo:104: 00000100:00100000:3.0:1787830004.209489:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830004.209559:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b412edcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830004.209735:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284139392 00000100:00100000:0.0:1787830004.209744:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284139392 00000100:00100000:0.0:1787830004.209807:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787830004.209822:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f99a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+3:14344:x1874675284139392:12345-0@lo:104: 00010000:00010000:0.0:1787830004.209836:0:14311:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7f600/0xc03b4d103c0d88da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d88e1 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830004.209907:0:14311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787830004.209913:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f99a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+3:14344:x1874675284139392:12345-0@lo:104: Request processed in 99us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830004.209921:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787830004.210753:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830004.210771:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7f600/0xc03b4d103c0d88da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d88e1 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830004.210784:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7f600 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:1.0:1787830004.210789:0:14317:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7f600/0xc03b4d103c0d88da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d88e1 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830004.210802:0:14317:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7f600/0xc03b4d103c0d88da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d88e1 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787830004.210844:0:14317:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7f600/0xc03b4d103c0d88da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d88e1 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830004.210850:0:14317:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787830004.210912:0:14317:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7f600/0xc03b4d103c0d88da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d88e1 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830004.210919:0:14317:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787830004.210953:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7f600/0xc03b4d103c0d88da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d88e1 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830004.210970:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7f600/0xc03b4d103c0d88da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d88e1 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830004.210994:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830004.210997:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830004.210998:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830004.211068:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787830004.211087:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3278:1874675284139520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787830004.211135:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830004.211237:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f99bc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14344:1874675284139392:0@lo:104: 00010000:00010000:1.0:1787830004.211608:0:14344:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e9b74898a00/0xc03b4d103c0d8912 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830004.211701:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284139520 00000100:00100000:1.0:1787830004.211709:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284139520 00010000:00010000:1.0:1787830004.211742:0:14313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b74e3e600/0xc03b4d103c0d88e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d88da expref: 13 pid: 14322 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830004.211783:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787830004.211793:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3ced00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+13:3278:x1874675284139520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787830004.211808:0:14313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830004.211826:0:14313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b74e3e600/0xc03b4d103c0d88e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d88da expref: 13 pid: 14322 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830004.211849:0:14313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b74e3e600/0xc03b4d103c0d88e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d88da expref: 13 pid: 14322 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830004.211867:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b74e3e600/0xc03b4d103c0d88e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d88da expref: 13 pid: 14322 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830004.211885:0:14313:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e9b74898a00/0xc03b4d103c0d8912 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830004.211895:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b74898a00/0xc03b4d103c0d8912 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787830004.211912:0:14313:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002638184s 00010000:00010000:1.0:1787830004.211917:0:14313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b74898a00/0xc03b4d103c0d8912 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830004.211925:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b74898a00/0xc03b4d103c0d8912 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830004.211933:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e9b74898a00/0xc03b4d103c0d8912 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830004.211940:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e9b74898a00/0xc03b4d103c0d8912 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830004.211945:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74898a00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:1.0:1787830004.211950:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e9b74898a00/0xc03b4d103c0d8912 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830004.213782:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e9b74898a00/0xc03b4d103c0d8912 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830004.225395:0:14344:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e9b74898a00/0xc03b4d103c0d8912 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830004.225418:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e9b74898a00/0xc03b4d103c0d8912 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830004.231373:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e9b74898a00/0xc03b4d103c0d8912 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830004.231413:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b74898a00/0xc03b4d103c0d8912 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830004.231444:0:14313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787830004.231578:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3ced00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:3278:x1874675284139520:12345-0@lo:103:ldlm_bl.0 Request processed in 19781us (20437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830004.231591:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787830004.233202:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3278:1874675284139520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787830004.252748:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7b5cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+11:14310:x1874675284139264:12345-0@lo:253:mount.lustre.0 Request processed in 143275us (143900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830004.252764:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787830004.253037:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14310:1874675284139264:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787830004.253058:0:14310:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787830004.253062:0:14310:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787830004.253064:0:14310:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787830004.253065:0:14310:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787830004.253067:0:14310:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787830004.253068:0:14310:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787830004.253070:0:14310:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787830004.253087:0:14310:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787830004.253088:0:14310:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787830004.253090:0:14310:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787830004.253092:0:14310:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787830004.253109:0:14310:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787830004.269352:0:14310:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787830004.269538:0:14310:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787830004.269820:0:14310:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787830004.277255:0:14310:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787830004.277666:0:14310:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787830004.277800:0:14310:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787830004.283193:0:14310:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787830004.285595:0:14310:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787830004.289846:0:14310:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787830004.290173:0:14310:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787830004.290461:0:14310:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787830004.290625:0:14310:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1787830004.399661:0:14310:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1787830004.400071:0:14310:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1787830004.400553:0:14368:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1787830004.400630:0:14368:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787830004.402772:0:14368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787830004.402856:0:14368:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787830004.402861:0:14368:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:1.0:1787830004.406064:0:14367:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1787830004.406071:0:14367:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1787830004.407112:0:14310:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787830004.407239:0:14310:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787830004.407756:0:14310:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787830004.407764:0:14310:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787830004.408118:0:14310:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787830004.411457:0:14310:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787830004.412269:0:14310:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787830004.412319:0:14310:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1787830004.414255:0:14310:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1787830004.433475:0:14310:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:2.0:1787830004.516804:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787830004.572409:0:14310:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787830004.572942:0:14310:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbcc5c1a77988 00100000:10000000:2.0:1787830004.572954:0:14310:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787830004.585613:0:14310:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787830004.585632:0:14310:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.151@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787830004.585647:0:14310:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1787830004.585669:0:14310:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 10000000:01000000:2.0:1787830004.962366:0:14325:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787830004.962374:0:14325:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e9b44e11000 from 6 10000000:01000000:2.0:1787830004.962379:0:14325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787830004.962431:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ea00/0xc03b4d103c0d8919 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830004.962443:0:14325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ea00/0xc03b4d103c0d8919 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830004.962454:0:14325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ea00/0xc03b4d103c0d8919 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830004.962482:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3cd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284139648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787830004.962552:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830004.962617:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fa50cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830004.962910:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284139648 00000100:00100000:0.0:1787830004.962919:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284139648 00000100:00100000:0.0:1787830004.962974:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787830004.962984:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7b5c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+11:14325:x1874675284139648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787830004.962997:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830004.963011:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b7fa7f400/0xc03b4d103c0d8920 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d8919 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830004.963070:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b7fa7f400/0xc03b4d103c0d8920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d8919 expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830004.963081:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b7fa7f400/0xc03b4d103c0d8920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d8919 expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830004.963089:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7fa7f400, rc 0) 00000100:00100000:0.0:1787830004.963131:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7b5c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:14325:x1874675284139648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830004.963138:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787830004.963305:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3cd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284139648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787830004.963322:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ea00/0xc03b4d103c0d8919 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8920 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830004.963332:0:14325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ea00/0xc03b4d103c0d8919 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d8920 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830004.963394:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3cd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284139776:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787830004.963429:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830004.963462:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fa50cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830004.963508:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284139776 00000100:00100000:0.0:1787830004.963512:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284139776 00000100:00100000:0.0:1787830004.963544:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787830004.963552:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7b5cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:14325:x1874675284139776:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787830004.963576:0:14322:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787830004.963593:0:14322:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787830004.963596:0:14322:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787830004.963673:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7b5cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:14325:x1874675284139776:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830004.963680:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787830004.963840:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3cd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284139776:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787830004.963887:0:14325:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787830004.963893:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ea00/0xc03b4d103c0d8919 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8920 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830004.963901:0:14325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ea00/0xc03b4d103c0d8919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8920 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787830005.155107:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787830005.540163:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787830006.178882:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787830006.562351:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830007.590484:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830008.610250:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787830009.190767:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787830009.190776:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787830009.190779:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787830009.190782:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787830009.190785:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787830009.190804:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787830009.190809:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e9b48ec8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787830009.190823:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e9b48ec8000 using connection 192.168.201.151@tcp/0@lo 00000100:00100000:3.0:1787830009.190849:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b7f99b480 x1874675284140032/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787830009.190924:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787830009.190939:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3281:1874675284139904:0@lo:400:kworker.0 00000100:00100000:3.0:1787830009.191053:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830009.191132:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284139904 00000100:00100000:3.0:1787830009.191140:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284139904 00000100:00100000:3.0:1787830009.191182:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787830009.191191:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7b5ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:3281:x1874675284139904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830009.191252:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7b5ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:3281:x1874675284139904:12345-0@lo:400:kworker.0 Request processed in 62us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830009.191260:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787830009.191310:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3281:1874675284139904:0@lo:400:kworker.0 00000100:00100000:0.0:1787830009.195283:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f99b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1874675284140032:0@lo:38:kworker.0 00000100:00100000:0.0:1787830009.195370:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830009.195664:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284140032 00000100:00100000:3.0:1787830009.195673:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284140032 00000100:00100000:3.0:1787830009.195715:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787830009.195722:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f311e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3277:x1874675284140032:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787830009.195751:0:14330:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 389 last 0 00000020:00000080:3.0:1787830009.195785:0:14330:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc03b4d103c0d8927 00000004:00100000:3.0:1787830009.195801:0:14330:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787830009.195995:0:14330:0:(import.c:65:import_set_state_nolock()) ffff9e9b75db6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787830009.198341:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f311e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1874675284140032:12345-0@lo:38:kworker.0 Request processed in 2607us (2960us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830009.198372:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787830009.203329:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e9b7f99b480 x1874675284140032/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787830019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787830009.203355:0:3277:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787830009.203365:0:3277:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787830009.203371:0:3277:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787830009.203375:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9e9b48ec8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787830009.203383:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f99b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1874675284140032:0@lo:38:kworker.0 00010000:00010000:0.0:1787830009.634184:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787830010.605481:0:14613:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg151-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787830010.665908:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830011.682528:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830012.707202:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830013.731519:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830014.315404:0:3277:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787830004/real 1787830004] req@ffff9e9b7f9983c0 x1874675284137344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830014 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830014.315438:0:3277:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e9b7f9983c0 x1874675284137344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830014 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830014.315448:0:3277:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787830004/real 1787830004] req@ffff9e9b7f3ccf00 x1874675284137216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830014 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830014.315458:0:3277:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e9b7f3ccf00 x1874675284137216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830014 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787830014.315480:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9e9b4f86f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787830014.315492:0:3277:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787830014.315496:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f9983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1874675284137344:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787830014.315513:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9e9b4f86a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787830014.315518:0:3277:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787830014.315520:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1874675284137216:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787830014.317160:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787830014.317166:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787830014.317169:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e9b4f86a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787830014.317177:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 383 00000100:00080000:2.0:1787830014.317183:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787830014.317190:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e9b4f86a000 using connection 192.168.201.151@tcp/0@lo 00000100:00100000:2.0:1787830014.317213:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b7f3cc780 x1874675284140288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787830014.317238:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787830014.317242:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787830014.317244:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e9b4f86f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787830014.317248:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 383 00000100:00080000:2.0:1787830014.317262:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787830014.317267:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e9b4f86f000 using connection 192.168.201.151@tcp/0@lo 00000100:00100000:2.0:1787830014.317296:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b7f3cf480 x1874675284140416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787830014.317346:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284140544:0@lo:400:kworker.0 00000100:00100000:2.0:1787830014.317417:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830014.317498:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284140544 00000100:00100000:2.0:1787830014.317505:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284140544 00000100:00100000:2.0:1787830014.317542:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787830014.317550:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284140544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830014.317597:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284140544:12345-0@lo:400:kworker.0 Request processed in 47us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830014.317605:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787830014.317639:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e9b7f3ce1c0 x1874675284140544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830014.317653:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284140544:0@lo:400:kworker.0 00000100:00100000:0.0:1787830014.317739:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787830014.317750:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3280:1874675284140160:0@lo:400:kworker.0 00000100:00100000:0.0:1787830014.317830:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830014.317870:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1874675284140288:0@lo:8:kworker.0 00000400:00000100:0.0:1787830014.317891:0:3277:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874675284140288 offset 0 length 520: 4 00000100:00100000:0.0:1787830014.317903:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1874675284140416:0@lo:8:kworker.0 00000400:00000100:0.0:1787830014.317917:0:3277:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874675284140416 offset 0 length 520: 4 00000100:00100000:2.0:1787830014.319102:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284140160 00000100:00100000:2.0:1787830014.319109:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284140160 00000100:00100000:2.0:1787830014.319152:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787830014.319160:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7b5ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:3280:x1874675284140160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830014.319269:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7b5ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:3280:x1874675284140160:12345-0@lo:400:kworker.0 Request processed in 109us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830014.319277:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787830014.327860:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3280:1874675284140160:0@lo:400:kworker.0 00010000:00010000:2.0:1787830014.754306:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787830014.759556:0:14763:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff4847b3e0 20000000:00000080:0.0:1787830014.759573:0:14763:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e9b749eb800 uarg=0000000000000000 20000000:01000000:0.0:1787830014.759606:0:14763:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787830014.759613:0:14763:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787830014.759617:0:14763:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787830014.763782:0:14764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1787830014.764054:0:14763:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787830014.776760:0:14763:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787830014.776943:0:14763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e9b7fa7e200/0xc03b4d103c0d892e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830014.776963:0:14763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d88ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d88e8 expref: 11 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830014.776971:0:14763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e9b7fa7e200/0xc03b4d103c0d892e lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830014.777060:0:14763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d88ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d88e8 expref: 11 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830014.777082:0:14763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d88ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d88e8 expref: 11 pid: 14322 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830014.777099:0:14763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f312d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14763:1874675284140672:0@lo:104: 00000100:00100000:0.0:1787830014.777175:0:14763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830014.777237:0:14763:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b75cfe900 going to sleep for 11 seconds 00000100:00100000:3.0:1787830014.777404:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284140672 00000100:00100000:3.0:1787830014.777412:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284140672 00000100:00100000:3.0:1787830014.777460:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787830014.777469:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f311680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+3:14763:x1874675284140672:12345-0@lo:104: 00010000:00010000:3.0:1787830014.777483:0:14312:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ec00/0xc03b4d103c0d88e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d88ef expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830014.777552:0:14312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787830014.777558:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f311680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+3:14763:x1874675284140672:12345-0@lo:104: Request processed in 91us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830014.777566:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787830014.777702:0:14763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f312d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14763:1874675284140672:0@lo:104: 00010000:00010000:0.0:1787830014.777727:0:14763:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e9b7fa7e200/0xc03b4d103c0d892e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830014.777866:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830014.777874:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ec00/0xc03b4d103c0d88e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d88ef expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830014.777883:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3ec00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:2.0:1787830014.777887:0:14317:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ec00/0xc03b4d103c0d88e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d88ef expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830014.777895:0:14317:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ec00/0xc03b4d103c0d88e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d88ef expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787830014.777903:0:14317:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ec00/0xc03b4d103c0d88e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d88ef expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830014.777909:0:14317:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787830014.777947:0:14317:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ec00/0xc03b4d103c0d88e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d88ef expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830014.777954:0:14317:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787830014.777974:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ec00/0xc03b4d103c0d88e8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d88ef expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830014.777981:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ec00/0xc03b4d103c0d88e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d88ef expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830014.777997:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830014.777999:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830014.778001:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830014.778476:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3279:1874675284140800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787830014.778568:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830014.779837:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284140800 00000100:00100000:2.0:1787830014.779866:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284140800 00010000:00010000:2.0:1787830014.779900:0:14314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d88ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d88e8 expref: 12 pid: 14322 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830014.779941:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787830014.779951:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbec780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:3279:x1874675284140800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787830014.779966:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830014.779970:0:14314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d88ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d88e8 expref: 12 pid: 14322 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830014.779993:0:14314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d88ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d88e8 expref: 12 pid: 14322 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830014.780013:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b7feef800/0xc03b4d103c0d88ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d88e8 expref: 12 pid: 14322 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830014.780201:0:14314:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e9b7fa7e200/0xc03b4d103c0d892e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830014.780210:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b7fa7e200/0xc03b4d103c0d892e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830014.780227:0:14314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b7fa7e200/0xc03b4d103c0d892e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830014.780235:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b7fa7e200/0xc03b4d103c0d892e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830014.780241:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e9b7fa7e200/0xc03b4d103c0d892e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830014.780248:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e9b7fa7e200/0xc03b4d103c0d892e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830014.780261:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7e200 already unused, calling callback (ffffffffc1651420) 00010000:00010000:2.0:1787830014.780265:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e9b7fa7e200/0xc03b4d103c0d892e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830014.780274:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e9b7fa7e200/0xc03b4d103c0d892e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830014.780290:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e9b7fa7e200/0xc03b4d103c0d892e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830014.780301:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830014.780363:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbec780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+11:3279:x1874675284140800:12345-0@lo:103:ldlm_bl.0 Request processed in 414us (1794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830014.780371:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787830014.780446:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3279:1874675284140800:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787830014.780628:0:14763:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e9b7fa7e200/0xc03b4d103c0d892e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830014.780637:0:14763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e9b7fa7e200/0xc03b4d103c0d892e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830014.780643:0:14763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b7fa7e200/0xc03b4d103c0d892e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830015.779944:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787830016.166243:0:14325:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787830016.166253:0:14325:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9b44e11000 from 10 10000000:01000000:2.0:1787830016.166259:0:14325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787830016.166310:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e800/0xc03b4d103c0d8935 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830016.166322:0:14325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e800/0xc03b4d103c0d8935 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830016.166333:0:14325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e800/0xc03b4d103c0d8935 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830016.166360:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3cfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284140928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787830016.166430:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830016.166486:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b534ed300 going to sleep for 11 seconds 00000100:00100000:0.0:1787830016.166674:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284140928 00000100:00100000:0.0:1787830016.166682:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284140928 00000100:00100000:0.0:1787830016.166748:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787830016.166759:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+11:14325:x1874675284140928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787830016.166773:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830016.166787:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b7fa7e200/0xc03b4d103c0d893c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d8935 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830016.166811:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b7fa7e200/0xc03b4d103c0d893c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d8935 expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830016.166829:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b7fa7e200/0xc03b4d103c0d893c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d8935 expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830016.166838:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7fa7e200, rc 0) 00000100:00100000:0.0:1787830016.166890:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:14325:x1874675284140928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830016.166898:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787830016.167064:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3cfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284140928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787830016.167077:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e800/0xc03b4d103c0d8935 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d893c expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830016.167096:0:14325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e800/0xc03b4d103c0d8935 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d893c expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830016.167146:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3cfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284141056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787830016.167171:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830016.167192:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b534ed300 going to sleep for 11 seconds 00000100:00100000:2.0:1787830016.167205:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284141056 00000100:00100000:2.0:1787830016.167208:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284141056 00000100:00100000:2.0:1787830016.167242:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787830016.167248:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:14325:x1874675284141056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787830016.167486:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:14325:x1874675284141056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830016.167492:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787830016.167519:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3cfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284141056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787830016.167546:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3cfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284141184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787830016.167578:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830016.167596:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b534ed300 going to sleep for 11 seconds 00000100:00100000:2.0:1787830016.167606:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284141184 00000100:00100000:2.0:1787830016.167609:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284141184 00000100:00100000:2.0:1787830016.167628:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787830016.167634:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:14325:x1874675284141184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787830016.167793:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:14325:x1874675284141184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830016.167805:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787830016.167841:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3cfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284141184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787830016.168542:0:14799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787830016.168603:0:14325:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787830016.168620:0:14325:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787830016.168629:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e800/0xc03b4d103c0d8935 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d893c expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830016.168641:0:14325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e800/0xc03b4d103c0d8935 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d893c expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787830016.431602:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787830016.807378:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830017.827277:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830018.850224:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787830019.426942:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787830019.426952:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787830019.426955:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787830019.426958:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787830019.427008:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874675284141440:0@lo:400:kworker.0 00000100:00100000:2.0:1787830019.427149:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830019.427231:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787830019.427239:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3281:1874675284141312:0@lo:400:kworker.0 00000100:00100000:2.0:1787830019.427276:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830019.427321:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284141440 00000100:00100000:2.0:1787830019.427332:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284141440 00000100:00100000:2.0:1787830019.427397:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787830019.427427:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874675284141440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830019.427492:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874675284141440:12345-0@lo:400:kworker.0 Request processed in 67us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830019.427501:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787830019.427530:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284141312 00000100:00100000:2.0:1787830019.427533:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284141312 00010000:00080000:3.0:1787830019.433323:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e9b7f3cc3c0 x1874675284141440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830019.433359:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874675284141440:0@lo:400:kworker.0 00000100:00100000:2.0:1787830019.442487:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787830019.442536:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:3281:x1874675284141312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830019.442964:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:3281:x1874675284141312:12345-0@lo:400:kworker.0 Request processed in 453us (15685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830019.445116:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3281:1874675284141312:0@lo:400:kworker.0 00000100:00100000:2.0:1787830019.452205:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1787830019.876207:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830020.901654:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787830021.260806:0:15012:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787830021.260810:0:15012:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1787830021.260919:0:15012:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e9b50685800 00000020:01000004:0.0:1787830021.260934:0:15012:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787830021.260947:0:15012:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787830021.260977:0:15012:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9e9b5391cd28) 00000020:00000080:0.0:1787830021.261099:0:15012:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787830021.297836:0:15012:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787830021.298351:0:15012:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787830021.299301:0:15012:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787830021.310401:0:15012:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787830021.311964:0:15012:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787830021.315704:0:15012:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 529: rc = 0 00100000:10000000:2.0:1787830021.315930:0:15012:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 529: rc = 0 00100000:10000000:2.0:1787830021.316079:0:15012:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 529: rc = 0 00100000:10000000:2.0:1787830021.316893:0:15012:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 400: rc = 0 00100000:10000000:2.0:1787830021.317905:0:15012:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 400: rc = 0 00100000:10000000:2.0:1787830021.318306:0:15012:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 400: rc = 0 00100000:10000000:2.0:1787830021.318716:0:15012:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 400: rc = 0 00100000:10000000:2.0:1787830021.319212:0:15012:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 400: rc = 0 00100000:10000000:2.0:1787830021.319711:0:15012:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 400: rc = 0 00000020:00000080:2.0:1787830021.321212:0:15012:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787830021.321225:0:15012:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787830021.321237:0:15012:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc03b4d103c0d894a 00000020:01000004:2.0:1787830021.321246:0:15012:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787830021.321276:0:15012:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.151@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787830021.321279:0:15012:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787830021.321285:0:15012:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787830021.321290:0:15012:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787830021.321302:0:15012:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9e9b4f8419b8) 00000020:00000080:2.0:1787830021.321314:0:15012:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1787830021.323106:0:15012:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787830021.323411:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787830021.323420:0:15012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787830021.329388:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787830021.329405:0:15012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787830021.331392:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787830021.331407:0:15012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787830021.336373:0:15012:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787830021.336613:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787830021.336621:0:15012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787830021.340763:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787830021.340790:0:15012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787830021.361130:0:15012:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787830021.361486:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787830021.361494:0:15012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787830021.363355:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787830021.363376:0:15012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787830021.365447:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787830021.365465:0:15012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787830021.373706:0:15012:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787830021.381874:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787830021.381885:0:15012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787830021.382566:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787830021.382585:0:15012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787830021.423355:0:15012:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787830021.423573:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787830021.423581:0:15012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787830021.436685:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787830021.436703:0:15012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787830021.437326:0:15012:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787830021.437353:0:15012:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787830021.437360:0:15012:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.151@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787830021.458556:0:15012:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.151@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787830021.458601:0:15012:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.151@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1787830021.458606:0:15012:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787830021.458607:0:15012:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787830021.458609:0:15012:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787830021.458610:0:15012:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787830021.458611:0:15012:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787830021.458612:0:15012:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787830021.458613:0:15012:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787830021.458615:0:15012:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787830021.458616:0:15012:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787830021.458620:0:15012:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1787830021.458623:0:15012:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787830021.458624:0:15012:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787830021.458625:0:15012:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787830021.458626:0:15012:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787830021.458627:0:15012:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787830021.458628:0:15012:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787830021.458629:0:15012:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787830021.458631:0:15012:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787830021.458631:0:15012:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787830021.458671:0:15012:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787830021.458693:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f312580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284141568:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787830021.458770:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830021.458835:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51d40c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787830021.458845:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284141568 00000100:00100000:1.0:1787830021.458853:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284141568 00000100:00100000:1.0:1787830021.458913:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787830021.458922:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:15012:x1874675284141568:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787830021.458961:0:14321:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787830021.458965:0:14321:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1787830021.458969:0:14321:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787830021.478819:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:15012:x1874675284141568:12345-0@lo:253:mount.lustre.0 Request processed in 19889us (20040us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830021.478833:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787830021.478964:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f312580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284141568:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787830021.478981:0:15012:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787830021.478984:0:15012:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787830021.478986:0:15012:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787830021.478988:0:15012:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787830021.478989:0:15012:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787830021.478998:0:15012:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787830021.479000:0:15012:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787830021.479001:0:15012:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787830021.479004:0:15012:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787830021.479005:0:15012:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787830021.479065:0:15012:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e9b50685800 from lustre-OST0000 10000000:01000000:0.0:1787830021.479094:0:15012:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787830021.479109:0:15012:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787830021.479117:0:15012:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e9b74bf3370 local copy 00010000:00010000:0.0:1787830021.479128:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b7feefe00/0xc03b4d103c0d8840 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8847 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830021.479348:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f312580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284141696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787830021.479386:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830021.479475:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51d40540 going to sleep for 11 seconds 00000100:00100000:2.0:1787830021.483100:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284141696 00000100:00100000:2.0:1787830021.483113:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284141696 00000100:00100000:3.0:1787830021.483259:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787830021.483270:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:15012:x1874675284141696:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787830021.483584:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:15012:x1874675284141696:12345-0@lo:501:mount.lustre.0 Request processed in 315us (4196us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787830021.483593:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787830021.483837:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f312580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284141696:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787830021.483862:0:15012:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787830021.484074:0:15012:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787830021.484084:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b7feefe00/0xc03b4d103c0d8840 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8847 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830021.484094:0:15012:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b7feefe00/0xc03b4d103c0d8840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8847 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830021.484122:0:15012:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e9b50685800 10000000:01000000:0.0:1787830021.484127:0:15012:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787830021.484132:0:15012:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9e9b74bf3370 10000000:01000000:0.0:1787830021.484134:0:15012:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787830021.484138:0:15012:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e9b74bf3370 from 1 10000000:01000000:0.0:1787830021.484141:0:15012:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787830021.484174:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7f800/0xc03b4d103c0d8958 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830021.484183:0:15012:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7f800/0xc03b4d103c0d8958 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830021.484205:0:15012:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7f800/0xc03b4d103c0d8958 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830021.484225:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f312580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284141824:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787830021.484263:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830021.484291:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51d40540 going to sleep for 11 seconds 00000100:00100000:1.0:1787830021.484552:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284141824 00000100:00100000:1.0:1787830021.484558:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284141824 00000100:00100000:1.0:1787830021.484597:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787830021.484605:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+12:15012:x1874675284141824:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787830021.484616:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830021.484636:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b7feeee00/0xc03b4d103c0d895f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d8958 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830021.484660:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b7feeee00/0xc03b4d103c0d895f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d8958 expref: 13 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830021.484670:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b7feeee00/0xc03b4d103c0d895f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d8958 expref: 13 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830021.484679:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feeee00, rc 0) 00000100:00100000:1.0:1787830021.484723:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+13:15012:x1874675284141824:12345-0@lo:101:mount.lustre.0 Request processed in 118us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830021.484730:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787830021.484870:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f312580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284141824:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787830021.484883:0:15012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7f800/0xc03b4d103c0d8958 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d895f expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830021.484891:0:15012:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7f800/0xc03b4d103c0d8958 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d895f expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830021.484907:0:15012:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787830021.484922:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7f800/0xc03b4d103c0d8958 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d895f expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830021.484929:0:15012:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7f800/0xc03b4d103c0d8958 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d895f expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830021.484935:0:15012:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787830021.484939:0:15012:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787830021.484943:0:15012:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787830021.484945:0:15012:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787830021.484959:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7ec00/0xc03b4d103c0d8966 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830021.484965:0:15012:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7ec00/0xc03b4d103c0d8966 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830021.484978:0:15012:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7ec00/0xc03b4d103c0d8966 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830021.485000:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f312580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284141952:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787830021.485060:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830021.485081:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51d40540 going to sleep for 11 seconds 00000100:00100000:3.0:1787830021.485189:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284141952 00000100:00100000:3.0:1787830021.485194:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284141952 00000100:00100000:3.0:1787830021.485228:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787830021.485236:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+13:15012:x1874675284141952:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787830021.485244:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830021.485253:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b74898600/0xc03b4d103c0d896d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d8966 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.485267:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b74898600/0xc03b4d103c0d896d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d8966 expref: 14 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.485275:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b74898600/0xc03b4d103c0d896d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d8966 expref: 14 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.485283:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74898600, rc 0) 00000100:00100000:3.0:1787830021.485320:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+14:15012:x1874675284141952:12345-0@lo:101:mount.lustre.0 Request processed in 85us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830021.485326:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787830021.485435:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f312580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284141952:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787830021.485446:0:15012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7ec00/0xc03b4d103c0d8966 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d896d expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830021.485454:0:15012:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7ec00/0xc03b4d103c0d8966 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d896d expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787830021.486127:0:15012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787830021.486939:0:15012:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787830021.487247:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787830021.487294:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787830021.487330:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787830021.487376:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787830021.487428:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787830021.487464:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787830021.487531:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787830021.487539:0:15012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787830021.487610:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f312580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284142080:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787830021.487663:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830021.487709:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51d40a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787830021.487950:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284142080 00000100:00100000:1.0:1787830021.487957:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284142080 00000100:00100000:1.0:1787830021.488012:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787830021.488050:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+14:15012:x1874675284142080:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787830021.488380:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+14:15012:x1874675284142080:12345-0@lo:501:mount.lustre.0 Request processed in 332us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830021.488389:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787830021.489389:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f312580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284142080:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787830021.489452:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f312580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284142208:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787830021.489505:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830021.489894:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284142208 00000100:00100000:1.0:1787830021.489900:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284142208 00000100:00100000:0.0:1787830021.490008:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51d40a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787830021.490649:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787830021.490661:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+14:15012:x1874675284142208:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787830021.491074:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+14:15012:x1874675284142208:12345-0@lo:503:mount.lustre.0 Request processed in 415us (1567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830021.491082:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787830021.491188:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f312580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284142208:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787830021.491974:0:15012:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787830021.492102:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f312580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284142336:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787830021.492151:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830021.499764:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51d40a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787830021.499937:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284142336 00000100:00100000:2.0:1787830021.499947:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284142336 00000100:00100000:2.0:1787830021.501042:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787830021.501057:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+14:15012:x1874675284142336:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787830021.501390:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+14:15012:x1874675284142336:12345-0@lo:502:mount.lustre.0 Request processed in 336us (9238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830021.501398:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787830021.501526:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f312580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284142336:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787830021.501822:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787830021.501881:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787830021.501915:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787830021.501965:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787830021.502035:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787830021.502075:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787830021.502129:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787830021.502165:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787830021.502199:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1787830021.502251:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1787830021.502304:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1787830021.502353:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1787830021.502393:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f312580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284142464:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787830021.502445:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830021.502489:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b51d40a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787830021.502659:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284142464 00000100:00100000:1.0:1787830021.502672:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284142464 00000100:00100000:1.0:1787830021.502705:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787830021.502713:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+14:15012:x1874675284142464:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787830021.502890:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+14:15012:x1874675284142464:12345-0@lo:502:mount.lustre.0 Request processed in 177us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830021.502898:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787830021.503478:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f312580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284142464:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787830021.503579:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1787830021.503601:0:15012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1787830021.504680:0:15026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787830021.504690:0:15026:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787830021.504696:0:15026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830021.504698:0:15026:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787830021.504703:0:15026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787830021.504717:0:15026:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9e9b5391b370) 00000020:00000080:0.0:1787830021.504738:0:15026:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787830021.504744:0:15026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787830021.504810:0:15026:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e9b50685800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787830021.504817:0:15026:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787830021.504825:0:15026:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc03b4d103c0d897b 00010000:00010000:0.0:1787830021.508913:0:15026:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1787830021.509644:0:15026:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1787830021.511836:0:15026:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787830021.514894:0:15026:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787830021.514906:0:15026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787830021.514913:0:15026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830021.514915:0:15026:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787830021.514918:0:15026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787830021.514921:0:15026:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1787830021.514922:0:15026:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787830021.514923:0:15026:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787830021.514925:0:15026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787830021.514928:0:15026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830021.514929:0:15026:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787830021.514931:0:15026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787830021.514934:0:15026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830021.514936:0:15026:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787830021.514938:0:15026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787830021.514940:0:15026:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787830021.514942:0:15026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787830021.514944:0:15026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830021.514946:0:15026:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787830021.514956:0:15026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787830021.514958:0:15026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830021.514960:0:15026:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787830021.514963:0:15026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787830021.515055:0:15026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787830021.515059:0:15026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830021.515060:0:15026:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787830021.515063:0:15026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1787830021.518655:0:15012:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787830021.518693:0:15012:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787830021.518713:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7ec00/0xc03b4d103c0d8966 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d896d expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830021.518725:0:15012:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b7fa7ec00/0xc03b4d103c0d8966 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d896d expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830021.518882:0:15012:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9b50685800 from 1 10000000:01000000:3.0:1787830021.518886:0:15012:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787830021.518926:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74898c00/0xc03b4d103c0d8982 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.518935:0:15012:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b74898c00/0xc03b4d103c0d8982 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.518957:0:15012:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b74898c00/0xc03b4d103c0d8982 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830021.518983:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284142592:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787830021.519078:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830021.519127:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b75d9c780 going to sleep for 11 seconds 00000100:00100000:2.0:1787830021.519641:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284142592 00000100:00100000:2.0:1787830021.519649:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284142592 00000100:00100000:2.0:1787830021.519700:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787830021.519716:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+14:15012:x1874675284142592:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787830021.519731:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830021.519744:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b74e3f400/0xc03b4d103c0d8989 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d8982 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830021.519767:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b74e3f400/0xc03b4d103c0d8989 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d8982 expref: 15 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830021.519777:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b74e3f400/0xc03b4d103c0d8989 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d8982 expref: 15 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830021.519787:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74e3f400, rc 0) 00000100:00100000:2.0:1787830021.519831:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+15:15012:x1874675284142592:12345-0@lo:101:mount.lustre.0 Request processed in 116us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830021.519838:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787830021.519941:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284142592:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787830021.519956:0:15012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b74898c00/0xc03b4d103c0d8982 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8989 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.519966:0:15012:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b74898c00/0xc03b4d103c0d8982 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d8989 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787830021.520513:0:15012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787830021.521012:0:15012:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787830021.521290:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787830021.521334:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787830021.521395:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787830021.521404:0:15012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787830021.521468:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284142720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787830021.521516:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830021.521568:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b75d9c780 going to sleep for 11 seconds 00000100:00100000:2.0:1787830021.521880:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284142720 00000100:00100000:2.0:1787830021.521887:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284142720 00000100:00100000:2.0:1787830021.521930:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787830021.521939:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+15:15012:x1874675284142720:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787830021.522184:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+15:15012:x1874675284142720:12345-0@lo:501:mount.lustre.0 Request processed in 246us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830021.522191:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787830021.522675:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284142720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787830021.522712:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284142848:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787830021.522784:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830021.522857:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b75d9c780 going to sleep for 11 seconds 00000100:00100000:3.0:1787830021.537902:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284142848 00000100:00100000:3.0:1787830021.537917:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284142848 00000100:00100000:3.0:1787830021.537967:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787830021.537978:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+15:15012:x1874675284142848:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787830021.538252:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+15:15012:x1874675284142848:12345-0@lo:503:mount.lustre.0 Request processed in 275us (15467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830021.538260:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787830021.538317:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284142848:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787830021.540031:0:15012:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787830021.540119:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284142976:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787830021.540191:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830021.540243:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4561f240 going to sleep for 11 seconds 00000100:00100000:3.0:1787830021.540278:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284142976 00000100:00100000:3.0:1787830021.540284:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284142976 00000100:00100000:3.0:1787830021.540312:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787830021.540321:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+15:15012:x1874675284142976:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787830021.540496:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+15:15012:x1874675284142976:12345-0@lo:502:mount.lustre.0 Request processed in 175us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830021.540504:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787830021.542549:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284142976:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787830021.542850:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787830021.542911:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787830021.542965:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787830021.543063:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787830021.543101:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787830021.543154:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787830021.543194:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787830021.543243:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787830021.543283:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284143104:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787830021.543350:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830021.543384:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b601e03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830021.543418:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284143104 00000100:00100000:3.0:1787830021.543422:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284143104 00000100:00100000:3.0:1787830021.543464:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787830021.543472:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+15:15012:x1874675284143104:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787830021.543647:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+15:15012:x1874675284143104:12345-0@lo:502:mount.lustre.0 Request processed in 175us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830021.543654:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787830021.543700:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284143104:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787830021.543778:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787830021.543787:0:15012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787830021.546055:0:15030:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787830021.546067:0:15030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830021.546070:0:15030:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787830021.546076:0:15030:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e9b50685800 00000020:00000080:1.0:1787830021.546079:0:15030:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787830021.546088:0:15030:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787830021.546090:0:15030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830021.546091:0:15030:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787830021.546094:0:15030:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787830021.546096:0:15030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830021.546098:0:15030:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787830021.546101:0:15030:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e9b50685800 00000020:00000080:1.0:1787830021.546103:0:15030:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787830021.546161:0:15030:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787830021.546165:0:15030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830021.546166:0:15030:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787830021.546168:0:15030:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787830021.546171:0:15030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830021.546172:0:15030:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787830021.546175:0:15030:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e9b50685800 00000020:00000080:1.0:1787830021.546177:0:15030:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787830021.546212:0:15030:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787830021.546216:0:15030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830021.546217:0:15030:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787830021.546221:0:15030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787830021.552514:0:15012:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787830021.552558:0:15012:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787830021.552582:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74898c00/0xc03b4d103c0d8982 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8989 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.552597:0:15012:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b74898c00/0xc03b4d103c0d8982 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8989 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830021.552645:0:15012:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787830021.552648:0:15012:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e9b50685800 10000000:01000000:3.0:1787830021.552651:0:15012:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e9b50685800 10000000:01000000:3.0:1787830021.552655:0:15012:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787830021.552661:0:15012:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e9b50685800 from 1 10000000:01000000:3.0:1787830021.552663:0:15012:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787830021.552703:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74898a00/0xc03b4d103c0d8990 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.552711:0:15012:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b74898a00/0xc03b4d103c0d8990 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.552721:0:15012:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b74898a00/0xc03b4d103c0d8990 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830021.552746:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284143232:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787830021.552822:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830021.552862:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b601e0180 going to sleep for 11 seconds 00000100:00100000:3.0:1787830021.552882:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284143232 00000100:00100000:3.0:1787830021.552889:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284143232 00000100:00100000:3.0:1787830021.552934:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787830021.552943:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+15:15012:x1874675284143232:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787830021.552955:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830021.552966:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b74899000/0xc03b4d103c0d8997 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d8990 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.553127:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b74899000/0xc03b4d103c0d8997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d8990 expref: 16 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.553139:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b74899000/0xc03b4d103c0d8997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d8990 expref: 16 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.553148:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74899000, rc 0) 00000100:00100000:3.0:1787830021.553184:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+16:15012:x1874675284143232:12345-0@lo:101:mount.lustre.0 Request processed in 242us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830021.553191:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787830021.553623:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284143232:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787830021.553639:0:15012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b74898a00/0xc03b4d103c0d8990 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8997 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.553648:0:15012:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b74898a00/0xc03b4d103c0d8990 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d8997 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787830021.555593:0:15012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1787830021.556818:0:15012:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787830021.557162:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787830021.557203:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787830021.557253:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787830021.557295:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787830021.557326:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787830021.557387:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787830021.557421:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787830021.557472:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787830021.557518:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787830021.557553:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787830021.557588:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787830021.557636:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787830021.557673:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787830021.557701:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787830021.557744:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787830021.557778:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787830021.557809:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787830021.557855:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787830021.557891:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787830021.557925:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787830021.557971:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787830021.560973:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787830021.561061:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787830021.561157:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787830021.561196:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787830021.561252:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787830021.561301:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787830021.561337:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787830021.561432:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787830021.561440:0:15012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1787830021.561532:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284143360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787830021.561999:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830021.562061:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b601e0180 going to sleep for 11 seconds 00000100:00100000:2.0:1787830021.562061:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284143360 00000100:00100000:2.0:1787830021.562067:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284143360 00000100:00100000:2.0:1787830021.562119:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787830021.562129:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+16:15012:x1874675284143360:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787830021.562362:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+16:15012:x1874675284143360:12345-0@lo:501:mount.lustre.0 Request processed in 234us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830021.562379:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787830021.562664:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284143360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787830021.562703:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284143488:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787830021.562743:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830021.562804:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b601e0180 going to sleep for 11 seconds 00000100:00100000:2.0:1787830021.568697:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284143488 00000100:00100000:2.0:1787830021.568713:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284143488 00000100:00100000:3.0:1787830021.568836:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787830021.568847:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+16:15012:x1874675284143488:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787830021.569217:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+16:15012:x1874675284143488:12345-0@lo:503:mount.lustre.0 Request processed in 371us (6472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830021.569226:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787830021.569295:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284143488:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787830021.569850:0:15012:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787830021.569923:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284143616:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787830021.569971:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830021.570035:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284143616 00000100:00100000:3.0:1787830021.570040:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284143616 00000100:00100000:3.0:1787830021.570067:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787830021.570082:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+16:15012:x1874675284143616:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787830021.570239:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+16:15012:x1874675284143616:12345-0@lo:502:mount.lustre.0 Request processed in 158us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830021.570246:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787830021.570288:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b601e0180 going to sleep for 11 seconds 00000100:00100000:3.0:1787830021.570304:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284143616:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787830021.570538:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787830021.570585:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787830021.570622:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787830021.570672:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787830021.570711:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787830021.570763:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787830021.570801:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787830021.570852:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787830021.570916:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787830021.570956:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787830021.571006:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787830021.571083:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787830021.571122:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787830021.571150:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787830021.571197:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787830021.571234:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787830021.571269:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787830021.571314:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787830021.571349:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787830021.571384:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787830021.571432:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787830021.571469:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787830021.571502:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787830021.571566:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787830021.571612:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787830021.571650:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787830021.571702:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787830021.571741:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787830021.571776:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787830021.571822:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787830021.571859:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787830021.571894:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787830021.571927:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787830021.571979:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787830021.585377:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787830021.585467:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787830021.585497:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787830021.585523:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787830021.585582:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787830021.585642:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787830021.585691:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284143744:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787830021.585764:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830021.585809:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b601e0180 going to sleep for 11 seconds 00000100:00100000:1.0:1787830021.586157:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284143744 00000100:00100000:1.0:1787830021.586170:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284143744 00000100:00100000:1.0:1787830021.586889:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787830021.586901:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+16:15012:x1874675284143744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787830021.587194:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+16:15012:x1874675284143744:12345-0@lo:502:mount.lustre.0 Request processed in 294us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830021.587202:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787830021.587326:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284143744:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787830021.587420:0:15012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787830021.587433:0:15012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787830021.589748:0:15035:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787830021.589767:0:15035:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9e9b539199b8) 00000020:00000080:0.0:1787830021.589789:0:15035:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1787830021.589883:0:15035:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e9b50685800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787830021.589887:0:15035:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e9b50685800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787830021.589890:0:15035:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e9b50685800 3 00010000:00080000:0.0:1787830021.589921:0:15035:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e9b6f181000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.151@tcp at head 00010000:00010000:3.0:1787830021.592982:0:15035:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1787830021.593770:0:15035:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787830021.593815:0:15035:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787830021.593830:0:15035:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc03b4d103c0d89a5 00000100:00080000:3.0:1787830021.593840:0:15035:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787830021.593847:0:15035:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e9b6f181000 using connection 192.168.201.151@tcp/0@lo 00000100:00100000:3.0:1787830021.593888:0:15035:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b7f999a40 x1874675284143872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787830021.593943:0:15035:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787830021.595417:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787830021.595425:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787830021.595428:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787830021.595430:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787830021.596236:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284144000:0@lo:400:kworker.0 00000100:00100000:3.0:1787830021.596317:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830021.596742:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1874675284143872:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787830021.596778:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830021.597062:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284144000 00000100:00100000:3.0:1787830021.597070:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284144000 00000100:00100000:3.0:1787830021.597117:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284143872 00000100:00100000:3.0:1787830021.597121:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284143872 00000100:00100000:3.0:1787830021.597135:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787830021.597144:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f99b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284144000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830021.597205:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f99b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284144000:12345-0@lo:400:kworker.0 Request processed in 62us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830021.597212:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787830021.597229:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787830021.597234:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1874675284143872:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787830021.597256:0:14328:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 401 last 0 00000020:00000080:3.0:1787830021.597291:0:14328:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc03b4d103c0d89ac 00000004:00100000:3.0:1787830021.597305:0:14328:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787830021.597339:0:14328:0:(import.c:65:import_set_state_nolock()) ffff9e9b43ebc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787830021.597377:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1874675284143872:12345-0@lo:38:llog_process_th.0 Request processed in 141us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830021.597385:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787830021.597422:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e9b7f3cf840 x1874675284144000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830021.597438:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284144000:0@lo:400:kworker.0 00010000:00080000:1.0:1787830021.598683:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e9b7f999a40 x1874675284143872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787830031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830021.598696:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787830021.598704:0:3277:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1787830021.598712:0:3277:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787830021.598717:0:3277:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787830021.598719:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9e9b6f181000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787830021.598726:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1874675284143872:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787830021.607275:0:15035:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1787830021.609723:0:15012:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787830021.609766:0:15012:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787830021.609793:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74898a00/0xc03b4d103c0d8990 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8997 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830021.609807:0:15012:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b74898a00/0xc03b4d103c0d8990 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8997 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787830021.609857:0:15012:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787830021.609859:0:15012:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787830021.609860:0:15012:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787830021.609862:0:15012:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787830021.609863:0:15012:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787830021.609864:0:15012:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787830021.609865:0:15012:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787830021.609867:0:15012:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787830021.609868:0:15012:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787830021.609872:0:15012:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787830021.609874:0:15012:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787830021.609880:0:15012:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787830021.609881:0:15012:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787830021.609882:0:15012:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787830021.609883:0:15012:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787830021.609884:0:15012:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787830021.609885:0:15012:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787830021.609886:0:15012:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787830021.609887:0:15012:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787830021.609914:0:15012:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787830021.609936:0:15012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f312580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284144128:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787830021.610044:0:15012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830021.610102:0:15012:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b43feb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830021.610684:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284144128 00000100:00100000:2.0:1787830021.610693:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284144128 00000100:00100000:2.0:1787830021.610751:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787830021.610760:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+16:15012:x1874675284144128:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787830021.610790:0:14321:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787830021.610803:0:14321:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787830021.676186:0:14321:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787830021.676205:0:14321:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787830021.676326:0:14344:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787830021.676332:0:14344:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787830021.676356:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e9b7feee800/0xc03b4d103c0d89b3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830021.676376:0:14344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b7fa7f400/0xc03b4d103c0d8920 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d8919 expref: 16 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830021.676386:0:14344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e9b7feee800/0xc03b4d103c0d89b3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830021.676427:0:14344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b7fa7f400/0xc03b4d103c0d8920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d8919 expref: 16 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830021.676456:0:14344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9b7fa7f400/0xc03b4d103c0d8920 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d8919 expref: 16 pid: 14323 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830021.676472:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbede00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14344:1874675284144256:0@lo:104: 00000100:00100000:1.0:1787830021.676558:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830021.676606:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47ae0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830021.676676:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284144256 00000100:00100000:3.0:1787830021.676684:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284144256 00000100:00100000:3.0:1787830021.676733:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787830021.676741:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbee940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+3:14344:x1874675284144256:12345-0@lo:104: 00010000:00010000:3.0:1787830021.676754:0:14311:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ea00/0xc03b4d103c0d8919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d8920 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.676808:0:14311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787830021.676814:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbee940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+3:14344:x1874675284144256:12345-0@lo:104: Request processed in 75us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830021.676822:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787830021.676841:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787830021.676847:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ea00/0xc03b4d103c0d8919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d8920 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.676855:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3ea00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:3.0:1787830021.676859:0:14316:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ea00/0xc03b4d103c0d8919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d8920 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.676867:0:14316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ea00/0xc03b4d103c0d8919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d8920 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787830021.676874:0:14316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ea00/0xc03b4d103c0d8919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d8920 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830021.676880:0:14316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787830021.676908:0:14316:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ea00/0xc03b4d103c0d8919 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d8920 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.676915:0:14316:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787830021.676942:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ea00/0xc03b4d103c0d8919 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d8920 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.676949:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ea00/0xc03b4d103c0d8919 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d8920 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.676964:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830021.676967:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830021.676968:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830021.677007:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3279:1874675284144384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787830021.677082:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830021.677129:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284144384 00000100:00100000:3.0:1787830021.677133:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284144384 00010000:00010000:3.0:1787830021.677148:0:14313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b7fa7f400/0xc03b4d103c0d8920 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d8919 expref: 17 pid: 14323 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830021.677168:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787830021.677174:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f99bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+17:3279:x1874675284144384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787830021.677184:0:14313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830021.677188:0:14313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b7fa7f400/0xc03b4d103c0d8920 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d8919 expref: 17 pid: 14323 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.677197:0:14313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b7fa7f400/0xc03b4d103c0d8920 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d8919 expref: 17 pid: 14323 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.677212:0:14313:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e9b7feee800/0xc03b4d103c0d89b3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.677219:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b7feee800/0xc03b4d103c0d89b3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787830021.677243:0:14313:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002638184s 00010000:00010000:3.0:1787830021.677247:0:14313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b7feee800/0xc03b4d103c0d89b3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.677254:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b7feee800/0xc03b4d103c0d89b3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.677261:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e9b7feee800/0xc03b4d103c0d89b3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.677268:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e9b7feee800/0xc03b4d103c0d89b3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.677273:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feee800 already unused, calling callback (ffffffffc1651420) 00010000:00010000:3.0:1787830021.677277:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e9b7feee800/0xc03b4d103c0d89b3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.677285:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e9b7feee800/0xc03b4d103c0d89b3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.677294:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e9b7feee800/0xc03b4d103c0d89b3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.677303:0:14313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787830021.677335:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f99bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+17:3279:x1874675284144384:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830021.677341:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787830021.677383:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3279:1874675284144384:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787830021.677410:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b7fa7f400/0xc03b4d103c0d8920 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d8919 expref: 16 pid: 14323 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830021.677427:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbede00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14344:1874675284144256:0@lo:104: 00010000:00010000:3.0:1787830021.677440:0:14344:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e9b7feee800/0xc03b4d103c0d89b3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.677448:0:14344:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e9b7feee800/0xc03b4d103c0d89b3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.677454:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e9b7feee800/0xc03b4d103c0d89b3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830021.677459:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b7feee800/0xc03b4d103c0d89b3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830021.692474:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+15:15012:x1874675284144128:12345-0@lo:253:mount.lustre.0 Request processed in 81706us (82450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830021.692488:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787830021.692656:0:15012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f312580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15012:1874675284144128:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787830021.692674:0:15012:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787830021.692677:0:15012:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787830021.692678:0:15012:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787830021.692680:0:15012:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787830021.692681:0:15012:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787830021.692682:0:15012:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787830021.692683:0:15012:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787830021.692685:0:15012:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787830021.692687:0:15012:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787830021.692688:0:15012:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787830021.692708:0:15012:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787830021.698181:0:15012:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787830021.698355:0:15012:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787830021.698517:0:15012:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787830021.698675:0:15012:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787830021.698822:0:15012:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787830021.699087:0:15012:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787830021.700855:0:15012:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787830021.823354:0:15012:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787830021.823364:0:15012:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787830021.823395:0:15012:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787830021.823458:0:15012:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.151@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787830021.823473:0:15012:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787830021.823499:0:15012:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787830021.929303:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787830022.755188:0:14325:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787830022.755199:0:14325:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e9b44e11000 from 7 10000000:01000000:3.0:1787830022.755206:0:14325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787830022.755275:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74899a00/0xc03b4d103c0d89ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830022.755290:0:14325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b74899a00/0xc03b4d103c0d89ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830022.755304:0:14325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b74899a00/0xc03b4d103c0d89ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830022.755338:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284144512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787830022.755439:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830022.755511:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b601e0840 going to sleep for 11 seconds 00000100:00100000:1.0:1787830022.755591:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284144512 00000100:00100000:1.0:1787830022.755600:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284144512 00000100:00100000:1.0:1787830022.755671:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787830022.755682:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6f5fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+15:14325:x1874675284144512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787830022.755699:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830022.755716:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b7feee600/0xc03b4d103c0d89c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d89ba expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830022.755745:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b7feee600/0xc03b4d103c0d89c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d89ba expref: 16 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830022.755757:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b7feee600/0xc03b4d103c0d89c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d89ba expref: 16 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830022.755769:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feee600, rc 0) 00000100:00100000:1.0:1787830022.755817:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6f5fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+16:14325:x1874675284144512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830022.755824:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787830022.755887:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284144512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787830022.755910:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b74899a00/0xc03b4d103c0d89ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d89c1 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830022.755927:0:14325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b74899a00/0xc03b4d103c0d89ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d89c1 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830022.755998:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbed680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284144640:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787830022.756049:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830022.756061:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47ae09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830022.756396:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284144640 00000100:00100000:3.0:1787830022.756402:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284144640 00000100:00100000:3.0:1787830022.756430:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787830022.756438:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6f5ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+16:14325:x1874675284144640:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787830022.756454:0:14323:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787830022.756477:0:14323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787830022.756480:0:14323:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787830022.756567:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6f5ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+16:14325:x1874675284144640:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830022.756575:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787830022.756674:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbed680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284144640:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787830022.756740:0:14325:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787830022.756747:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74899a00/0xc03b4d103c0d89ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d89c1 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830022.756756:0:14325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b74899a00/0xc03b4d103c0d89ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d89c1 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830022.951677:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830023.977213:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830024.994595:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830026.018224:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787830026.595511:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787830026.595519:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787830026.595522:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787830026.595526:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787830026.595672:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f310b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874675284144896:0@lo:400:kworker.0 00000100:00100000:1.0:1787830026.595749:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830026.595805:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787830026.595811:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f310000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3281:1874675284144768:0@lo:400:kworker.0 00000100:00100000:1.0:1787830026.595837:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830026.595870:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284144768 00000100:00100000:1.0:1787830026.595876:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284144768 00000100:00100000:1.0:1787830026.595926:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787830026.595936:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6f5fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+16:3281:x1874675284144768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830026.595980:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6f5fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+16:3281:x1874675284144768:12345-0@lo:400:kworker.0 Request processed in 46us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830026.595998:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787830026.596066:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f310000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3281:1874675284144768:0@lo:400:kworker.0 00000100:00100000:0.0:1787830026.596145:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284144896 00000100:00100000:0.0:1787830026.596149:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284144896 00000100:00100000:0.0:1787830026.596176:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787830026.596183:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874675284144896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830026.596218:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874675284144896:12345-0@lo:400:kworker.0 Request processed in 35us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830026.596225:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787830026.596351:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b7f310b40 x1874675284144896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830026.596363:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f310b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874675284144896:0@lo:400:kworker.0 00000100:00100000:3.0:1787830026.596644:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f312940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284145024:0@lo:400:kworker.0 00000100:00100000:3.0:1787830026.596676:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830026.596807:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284145024 00000100:00100000:1.0:1787830026.596812:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284145024 00000100:00100000:1.0:1787830026.596851:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787830026.596857:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f999e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284145024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830026.596893:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f999e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284145024:12345-0@lo:400:kworker.0 Request processed in 36us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830026.596899:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787830026.596935:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b7f312940 x1874675284145024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830026.596945:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f312940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284145024:0@lo:400:kworker.0 00000100:00080000:0.0:1787830026.597009:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1787830026.675408:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787830027.053449:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830028.077629:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787830028.866000:0:15380:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg151-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787830029.091493:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830029.794394:0:3277:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787830014/real 1787830014] req@ffff9e9b7f3cc780 x1874675284140288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830029 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830029.794432:0:3277:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e9b7f3cc780 x1874675284140288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830029 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830029.794460:0:3277:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787830014/real 1787830014] req@ffff9e9b7f3cf480 x1874675284140416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830029 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830029.794486:0:3277:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e9b7f3cf480 x1874675284140416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830029 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787830029.794506:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9e9b4f86a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787830029.794528:0:3277:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787830029.794533:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1874675284140288:0@lo:8:kworker.0 00000100:00080000:2.0:1787830029.794539:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9e9b4f86f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787830029.794543:0:3277:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787830029.794546:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1874675284140416:0@lo:8:kworker.0 00000100:00080000:1.0:1787830029.794667:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787830029.794672:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787830029.794675:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e9b4f86a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787830029.794680:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 394 00000100:00080000:1.0:1787830029.794684:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787830029.794691:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e9b4f86a000 using connection 192.168.201.151@tcp/0@lo 00000100:00100000:1.0:1787830029.794712:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b7fbef840 x1874675284145280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787830029.794738:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787830029.794741:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787830029.794742:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e9b4f86f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787830029.794746:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 394 00000100:00080000:1.0:1787830029.794748:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787830029.794751:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e9b4f86f000 using connection 192.168.201.151@tcp/0@lo 00000100:00100000:1.0:1787830029.794763:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b7fbec3c0 x1874675284145408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787830029.794815:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1874675284145280:0@lo:8:kworker.0 00000100:00100000:1.0:1787830029.794898:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830029.794948:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1874675284145408:0@lo:8:kworker.0 00000100:00100000:1.0:1787830029.794975:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830029.795003:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1874675284145664:0@lo:400:kworker.0 00000100:00100000:1.0:1787830029.795059:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830029.795078:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787830029.795084:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874675284145536:0@lo:400:kworker.0 00000100:00100000:1.0:1787830029.795105:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830029.795138:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284145664 00000100:00100000:1.0:1787830029.795145:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284145664 00000100:00100000:1.0:1787830029.795191:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284145536 00000100:00100000:1.0:1787830029.795194:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284145536 00000100:00100000:1.0:1787830029.795209:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787830029.795217:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874675284145664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830029.795264:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874675284145664:12345-0@lo:400:kworker.0 Request processed in 47us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830029.795278:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787830029.795295:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787830029.795302:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874675284145536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830029.795331:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874675284145536:12345-0@lo:400:kworker.0 Request processed in 30us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830029.795337:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787830029.795378:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b7fbee580 x1874675284145536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830029.795392:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874675284145536:0@lo:400:kworker.0 00010000:00080000:1.0:1787830029.795402:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b7fbec000 x1874675284145664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830029.795410:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1874675284145664:0@lo:400:kworker.0 00000100:00100000:0.0:1787830029.795481:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787830029.795491:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3278:1874675284145152:0@lo:400:kworker.0 00000100:00100000:0.0:1787830029.795527:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830029.795581:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284145280 00000100:00100000:0.0:1787830029.795585:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284145280 00000100:00100000:0.0:1787830029.795606:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284145408 00000100:00100000:0.0:1787830029.795609:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284145408 00000100:00100000:0.0:1787830029.795619:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787830029.795624:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3277:x1874675284145280:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787830029.795649:0:15013:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 409 last 0 00000020:00000080:0.0:1787830029.795689:0:15013:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc03b4d103c0d89c8 00002000:00100000:0.0:1787830029.795703:0:15013:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e9b6e961000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113940 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787830029.795708:0:15013:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787830029.795711:0:15013:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787830029.796090:0:15013:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787830029.796113:0:15013:0:(import.c:65:import_set_state_nolock()) ffff9e9b6e967800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787830029.796157:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3277:x1874675284145280:12345-0@lo:8:kworker.0 Request processed in 531us (1258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830029.796164:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787830029.796178:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787830029.796183:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3277:x1874675284145408:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787830029.796194:0:15013:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787830029.796220:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3277:x1874675284145408:12345-0@lo:8:kworker.0 Request processed in 36us (1245us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787830029.796226:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787830029.796243:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787830029.796265:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b7fbef840 x1874675284145280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787830049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830029.796274:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787830029.796281:0:3277:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787830029.796288:0:3277:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787830029.796293:0:3277:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787830029.796294:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9e9b4f86a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787830029.796307:0:3277:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787830029.796311:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1874675284145280:0@lo:8:kworker.0 00000100:00080000:0.0:1787830029.796324:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9e9b4f86f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787830029.796335:0:3277:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787830029.796339:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1874675284145408:0@lo:8:kworker.0 00000004:00080000:0.0:1787830029.796390:0:14351:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:0.0:1787830029.796408:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3103c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14351:1874675284145920:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787830029.796438:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830029.796453:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b48f90cc0 going to sleep for 11 seconds 00000004:00080000:0.0:1787830029.796467:0:14350:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787830029.796679:0:14350:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 409697660857ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787830029.796724:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284145792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787830029.796752:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830029.796788:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284145792 00000100:00100000:0.0:1787830029.796793:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284145792 00000100:00100000:0.0:1787830029.796823:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787830029.796831:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f312940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1874675284145792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787830029.796866:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787830029.796903:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f312940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1874675284145792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830029.796910:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787830029.796924:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787830029.796941:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b7f3112c0 x1874675284145792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830029.796956:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284145792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787830029.796973:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284145920 00000100:00100000:0.0:1787830029.796977:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284145920 00000100:00100000:0.0:1787830029.796995:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787830029.797001:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f313c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14351:x1874675284145920:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787830029.799230:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284145152 00000100:00100000:1.0:1787830029.799241:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284145152 00000100:00100000:1.0:1787830029.799296:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787830029.799305:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6f5fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+16:3278:x1874675284145152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830029.799417:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6f5fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+16:3278:x1874675284145152:12345-0@lo:400:kworker.0 Request processed in 113us (3889us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830029.799425:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787830029.799725:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3278:1874675284145152:0@lo:400:kworker.0 00002000:00080000:0.0:1787830029.812422:0:15013:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787830029.812433:0:15013:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787830029.812438:0:15013:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:0.0:1787830029.867734:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787830029.867751:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003713e14b/0xc03b4d103c0d89cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.867773:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787830029.867779:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830029.867788:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003713e14b/0xc03b4d103c0d89cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.867822:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003713e14b/0xc03b4d103c0d89cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.867835:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003713e14b/0xc03b4d103c0d89cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.867843:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003713e14b/0xc03b4d103c0d89cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.867894:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787830029.868479:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787830029.868487:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004906520a/0xc03b4d103c0d89d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.868497:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787830029.868506:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830029.868510:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004906520a/0xc03b4d103c0d89d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.868520:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004906520a/0xc03b4d103c0d89d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.868527:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004906520a/0xc03b4d103c0d89d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.868535:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004906520a/0xc03b4d103c0d89d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.868557:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787830029.868578:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787830029.868585:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003713e14b/0xc03b4d103c0d89cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.868595:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7fe00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787830029.868600:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003713e14b/0xc03b4d103c0d89cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.868610:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003713e14b/0xc03b4d103c0d89cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.868631:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003713e14b/0xc03b4d103c0d89cf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.868651:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003713e14b/0xc03b4d103c0d89cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.868671:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830029.868675:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004906520a/0xc03b4d103c0d89d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.868681:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7f200 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787830029.868684:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004906520a/0xc03b4d103c0d89d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.868691:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004906520a/0xc03b4d103c0d89d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.868702:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004906520a/0xc03b4d103c0d89d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.868708:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004906520a/0xc03b4d103c0d89d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.868719:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830029.868720:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830029.868722:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830029.871840:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787830029.878523:0:5827:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1787830029.880922:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787830029.880941:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dab19217/0xc03b4d103c0d89dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.880973:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787830029.880980:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830029.880989:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dab19217/0xc03b4d103c0d89dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.881006:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dab19217/0xc03b4d103c0d89dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.881052:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dab19217/0xc03b4d103c0d89dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.881063:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dab19217/0xc03b4d103c0d89dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.881094:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787830029.881116:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830029.881124:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dab19217/0xc03b4d103c0d89dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.881134:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7f400 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787830029.881140:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dab19217/0xc03b4d103c0d89dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.881151:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dab19217/0xc03b4d103c0d89dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.881189:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dab19217/0xc03b4d103c0d89dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.881197:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dab19217/0xc03b4d103c0d89dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.881222:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830029.881223:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830029.881226:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830029.882185:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787830029.882198:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab5a67a0/0xc03b4d103c0d89e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.882211:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787830029.882216:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830029.882223:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab5a67a0/0xc03b4d103c0d89e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.882234:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab5a67a0/0xc03b4d103c0d89e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.882243:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab5a67a0/0xc03b4d103c0d89e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.882250:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab5a67a0/0xc03b4d103c0d89e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.882289:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787830029.882305:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830029.882311:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab5a67a0/0xc03b4d103c0d89e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.882319:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7fa00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787830029.882324:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab5a67a0/0xc03b4d103c0d89e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.882334:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab5a67a0/0xc03b4d103c0d89e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.882348:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab5a67a0/0xc03b4d103c0d89e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.882356:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab5a67a0/0xc03b4d103c0d89e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.882374:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830029.882376:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830029.882378:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830029.887061:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787830029.887083:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af060259/0xc03b4d103c0d89eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.887106:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787830029.887124:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830029.887134:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af060259/0xc03b4d103c0d89eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.887151:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af060259/0xc03b4d103c0d89eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.887163:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af060259/0xc03b4d103c0d89eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.887171:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af060259/0xc03b4d103c0d89eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.887207:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830029.887223:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830029.887238:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af060259/0xc03b4d103c0d89eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.887264:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7f600 already unused, calling callback (ffffffffc1651420) 00010000:00010000:1.0:1787830029.887269:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af060259/0xc03b4d103c0d89eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.887281:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af060259/0xc03b4d103c0d89eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.887309:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af060259/0xc03b4d103c0d89eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.887317:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af060259/0xc03b4d103c0d89eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.887346:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830029.887348:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830029.887349:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830029.891593:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787830029.891612:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090d1269f/0xc03b4d103c0d89f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.891634:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787830029.891639:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830029.891648:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090d1269f/0xc03b4d103c0d89f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.891665:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090d1269f/0xc03b4d103c0d89f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.891688:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090d1269f/0xc03b4d103c0d89f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.891705:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090d1269f/0xc03b4d103c0d89f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.891738:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787830029.892543:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787830029.892553:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aba0d2be/0xc03b4d103c0d89f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.892566:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787830029.892570:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830029.892576:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aba0d2be/0xc03b4d103c0d89f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.892588:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aba0d2be/0xc03b4d103c0d89f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.892598:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aba0d2be/0xc03b4d103c0d89f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.892605:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aba0d2be/0xc03b4d103c0d89f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.892634:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787830029.892657:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787830029.892667:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090d1269f/0xc03b4d103c0d89f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.892685:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7e800 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787830029.892691:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090d1269f/0xc03b4d103c0d89f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.892701:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090d1269f/0xc03b4d103c0d89f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.892723:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090d1269f/0xc03b4d103c0d89f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.892732:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090d1269f/0xc03b4d103c0d89f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.892757:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830029.892761:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aba0d2be/0xc03b4d103c0d89f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.892768:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7e400 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787830029.892771:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aba0d2be/0xc03b4d103c0d89f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.892779:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aba0d2be/0xc03b4d103c0d89f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.892789:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aba0d2be/0xc03b4d103c0d89f9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.893652:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aba0d2be/0xc03b4d103c0d89f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.893690:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830029.893693:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830029.893696:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830029.894721:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830029.895540:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787830029.895553:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd214991/0xc03b4d103c0d8a00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.895573:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787830029.895578:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830029.895588:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd214991/0xc03b4d103c0d8a00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.895603:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd214991/0xc03b4d103c0d8a00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.895614:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd214991/0xc03b4d103c0d8a00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.895622:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd214991/0xc03b4d103c0d8a00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.895652:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830029.897654:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830029.897670:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd214991/0xc03b4d103c0d8a00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.897687:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7f000 already unused, calling callback (ffffffffc1651420) 00010000:00010000:1.0:1787830029.897692:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd214991/0xc03b4d103c0d8a00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.897704:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd214991/0xc03b4d103c0d8a00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.897745:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd214991/0xc03b4d103c0d8a00 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.897754:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd214991/0xc03b4d103c0d8a00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.897788:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830029.897792:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830029.897795:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830029.899118:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787830029.899142:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf307cbb/0xc03b4d103c0d8a07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.899163:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787830029.899168:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830029.899177:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf307cbb/0xc03b4d103c0d8a07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.899192:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf307cbb/0xc03b4d103c0d8a07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.899204:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf307cbb/0xc03b4d103c0d8a07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.899213:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf307cbb/0xc03b4d103c0d8a07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.899309:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787830029.902293:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787830029.902312:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025b93694/0xc03b4d103c0d8a0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.902333:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787830029.902338:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830029.902347:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025b93694/0xc03b4d103c0d8a0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.902362:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025b93694/0xc03b4d103c0d8a0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.902382:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025b93694/0xc03b4d103c0d8a0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.902391:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025b93694/0xc03b4d103c0d8a0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830029.902823:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787830029.903539:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf307cbb/0xc03b4d103c0d8a07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830029.903553:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7e000 already unused, calling callback (ffffffffc1651420) 00010000:00010000:2.0:1787830029.903560:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf307cbb/0xc03b4d103c0d8a07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830029.903571:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf307cbb/0xc03b4d103c0d8a07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830029.903600:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf307cbb/0xc03b4d103c0d8a07 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830029.903628:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf307cbb/0xc03b4d103c0d8a07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830029.903662:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830029.903667:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025b93694/0xc03b4d103c0d8a0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830029.903675:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7fa7ea00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:2.0:1787830029.903748:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025b93694/0xc03b4d103c0d8a0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830029.903758:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025b93694/0xc03b4d103c0d8a0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830029.903769:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025b93694/0xc03b4d103c0d8a0e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830029.903779:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830029.903781:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830029.903785:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830029.904300:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787830029.904309:0:15013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025b93694/0xc03b4d103c0d8a0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.905768:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830029.906948:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787830029.906961:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001120d8f3/0xc03b4d103c0d8a15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.906981:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787830029.906987:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830029.906995:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001120d8f3/0xc03b4d103c0d8a15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.907011:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001120d8f3/0xc03b4d103c0d8a15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.907052:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001120d8f3/0xc03b4d103c0d8a15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.907075:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001120d8f3/0xc03b4d103c0d8a15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.907104:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787830029.907582:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787830029.907589:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062341f7a/0xc03b4d103c0d8a1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.907599:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787830029.907603:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830029.907608:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062341f7a/0xc03b4d103c0d8a1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.907618:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062341f7a/0xc03b4d103c0d8a1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.907626:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062341f7a/0xc03b4d103c0d8a1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.907632:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062341f7a/0xc03b4d103c0d8a1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.907655:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787830029.908114:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787830029.908121:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bf69d1d/0xc03b4d103c0d8a23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.908139:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787830029.908143:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830029.908147:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bf69d1d/0xc03b4d103c0d8a23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.908156:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bf69d1d/0xc03b4d103c0d8a23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.908164:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bf69d1d/0xc03b4d103c0d8a23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.908171:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bf69d1d/0xc03b4d103c0d8a23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.908180:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787830029.908331:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787830029.908349:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001120d8f3/0xc03b4d103c0d8a15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.908366:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b82175800 already unused, calling callback (ffffffffc1651420) 00010000:00010000:1.0:1787830029.908372:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001120d8f3/0xc03b4d103c0d8a15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.908398:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001120d8f3/0xc03b4d103c0d8a15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.908425:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001120d8f3/0xc03b4d103c0d8a15 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.908435:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001120d8f3/0xc03b4d103c0d8a15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.908495:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787830029.908500:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062341f7a/0xc03b4d103c0d8a1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.908508:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b82174e00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:1.0:1787830029.908511:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062341f7a/0xc03b4d103c0d8a1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.908521:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062341f7a/0xc03b4d103c0d8a1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.908533:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062341f7a/0xc03b4d103c0d8a1c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.908540:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062341f7a/0xc03b4d103c0d8a1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.908557:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830029.908561:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bf69d1d/0xc03b4d103c0d8a23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.908568:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b82174000 already unused, calling callback (ffffffffc1651420) 00010000:00010000:1.0:1787830029.908572:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bf69d1d/0xc03b4d103c0d8a23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.908593:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bf69d1d/0xc03b4d103c0d8a23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.908604:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bf69d1d/0xc03b4d103c0d8a23 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.908611:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bf69d1d/0xc03b4d103c0d8a23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.908628:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830029.908631:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830029.908633:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830029.908644:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787830029.908653:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af63cf5c/0xc03b4d103c0d8a2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.908662:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787830029.908665:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830029.908669:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af63cf5c/0xc03b4d103c0d8a2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.908678:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af63cf5c/0xc03b4d103c0d8a2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.908698:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af63cf5c/0xc03b4d103c0d8a2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.908706:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af63cf5c/0xc03b4d103c0d8a2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.908730:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830029.908868:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830029.908875:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af63cf5c/0xc03b4d103c0d8a2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.908883:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b82174400 already unused, calling callback (ffffffffc1651420) 00010000:00010000:1.0:1787830029.908887:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af63cf5c/0xc03b4d103c0d8a2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.908895:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af63cf5c/0xc03b4d103c0d8a2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.908906:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af63cf5c/0xc03b4d103c0d8a2a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.908925:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af63cf5c/0xc03b4d103c0d8a2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.908941:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830029.908943:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830029.908945:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830029.909189:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830029.913771:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787830029.913787:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081487eda/0xc03b4d103c0d8a31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.913822:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787830029.913901:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830029.913909:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081487eda/0xc03b4d103c0d8a31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.913926:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081487eda/0xc03b4d103c0d8a31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.913937:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081487eda/0xc03b4d103c0d8a31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.913945:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081487eda/0xc03b4d103c0d8a31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.913980:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787830029.916628:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787830029.916649:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fe6d83e/0xc03b4d103c0d8a38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.916670:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787830029.916738:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830029.916749:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fe6d83e/0xc03b4d103c0d8a38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.916767:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fe6d83e/0xc03b4d103c0d8a38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.916779:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fe6d83e/0xc03b4d103c0d8a38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.916786:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fe6d83e/0xc03b4d103c0d8a38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.917362:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787830029.917381:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787830029.917391:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081487eda/0xc03b4d103c0d8a31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.917403:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b6fd07000 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787830029.917418:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081487eda/0xc03b4d103c0d8a31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.917429:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081487eda/0xc03b4d103c0d8a31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.917453:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081487eda/0xc03b4d103c0d8a31 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.917462:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081487eda/0xc03b4d103c0d8a31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.917486:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830029.917490:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fe6d83e/0xc03b4d103c0d8a38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.917496:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b6fd06200 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787830029.917499:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fe6d83e/0xc03b4d103c0d8a38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.917506:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fe6d83e/0xc03b4d103c0d8a38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.917517:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fe6d83e/0xc03b4d103c0d8a38 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.917523:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fe6d83e/0xc03b4d103c0d8a38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.917545:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830029.917547:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830029.917550:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830029.918239:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830029.922304:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787830029.922322:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009730c3ba/0xc03b4d103c0d8a3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.922343:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787830029.922349:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830029.922357:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009730c3ba/0xc03b4d103c0d8a3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.922373:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009730c3ba/0xc03b4d103c0d8a3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.922384:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009730c3ba/0xc03b4d103c0d8a3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.922391:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009730c3ba/0xc03b4d103c0d8a3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.922425:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830029.922485:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830029.922502:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009730c3ba/0xc03b4d103c0d8a3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.922518:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b6fd06000 already unused, calling callback (ffffffffc1651420) 00010000:00010000:1.0:1787830029.922524:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009730c3ba/0xc03b4d103c0d8a3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.922537:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009730c3ba/0xc03b4d103c0d8a3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.922561:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009730c3ba/0xc03b4d103c0d8a3f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.922570:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009730c3ba/0xc03b4d103c0d8a3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.922597:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830029.922600:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830029.922614:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830029.927333:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787830029.927354:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030003939/0xc03b4d103c0d8a46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.927392:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787830029.927399:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830029.927408:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030003939/0xc03b4d103c0d8a46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.928541:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030003939/0xc03b4d103c0d8a46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.928567:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030003939/0xc03b4d103c0d8a46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.928576:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030003939/0xc03b4d103c0d8a46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.928800:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787830029.928994:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830029.929005:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030003939/0xc03b4d103c0d8a46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.929060:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b6fd07600 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787830029.929067:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030003939/0xc03b4d103c0d8a46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.929077:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030003939/0xc03b4d103c0d8a46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.929126:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030003939/0xc03b4d103c0d8a46 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.929135:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030003939/0xc03b4d103c0d8a46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.929182:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830029.929186:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830029.929189:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830029.940126:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787830029.940147:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf80fbab/0xc03b4d103c0d8a4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.940169:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787830029.940176:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830029.940184:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf80fbab/0xc03b4d103c0d8a4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.940202:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf80fbab/0xc03b4d103c0d8a4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.940215:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf80fbab/0xc03b4d103c0d8a4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.940225:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf80fbab/0xc03b4d103c0d8a4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.940275:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787830029.941127:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787830029.941137:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004460bb9a/0xc03b4d103c0d8a54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.941151:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787830029.941156:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830029.941163:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004460bb9a/0xc03b4d103c0d8a54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.941175:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004460bb9a/0xc03b4d103c0d8a54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.941184:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004460bb9a/0xc03b4d103c0d8a54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.941190:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004460bb9a/0xc03b4d103c0d8a54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.941215:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787830029.941232:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787830029.941239:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf80fbab/0xc03b4d103c0d8a4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.941246:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b6fd07a00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787830029.941258:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf80fbab/0xc03b4d103c0d8a4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.941268:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf80fbab/0xc03b4d103c0d8a4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.941288:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf80fbab/0xc03b4d103c0d8a4d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.941296:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf80fbab/0xc03b4d103c0d8a4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.941320:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830029.941324:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004460bb9a/0xc03b4d103c0d8a54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.941330:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b6fd06400 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787830029.941333:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004460bb9a/0xc03b4d103c0d8a54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.941340:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004460bb9a/0xc03b4d103c0d8a54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.941349:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004460bb9a/0xc03b4d103c0d8a54 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.941356:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004460bb9a/0xc03b4d103c0d8a54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.941377:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830029.941379:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830029.941381:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830029.944123:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787830029.944144:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a8e7bda/0xc03b4d103c0d8a5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.944165:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787830029.944170:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830029.944178:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a8e7bda/0xc03b4d103c0d8a5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.944194:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a8e7bda/0xc03b4d103c0d8a5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.944206:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a8e7bda/0xc03b4d103c0d8a5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.944215:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a8e7bda/0xc03b4d103c0d8a5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.944247:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787830029.944270:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830029.944277:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a8e7bda/0xc03b4d103c0d8a5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.944308:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b6fd06e00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787830029.944313:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a8e7bda/0xc03b4d103c0d8a5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.944323:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a8e7bda/0xc03b4d103c0d8a5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.944343:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a8e7bda/0xc03b4d103c0d8a5b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.944352:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a8e7bda/0xc03b4d103c0d8a5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.944382:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830029.944384:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830029.944385:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830029.945823:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830029.949594:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787830029.949617:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000430d52f8/0xc03b4d103c0d8a62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.949640:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787830029.949646:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830029.949654:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000430d52f8/0xc03b4d103c0d8a62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.949673:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000430d52f8/0xc03b4d103c0d8a62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.949947:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000430d52f8/0xc03b4d103c0d8a62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.949958:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000430d52f8/0xc03b4d103c0d8a62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.950108:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787830029.955646:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787830029.955669:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ce7525c/0xc03b4d103c0d8a69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.955948:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787830029.955954:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830029.955963:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ce7525c/0xc03b4d103c0d8a69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.955980:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ce7525c/0xc03b4d103c0d8a69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.955993:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ce7525c/0xc03b4d103c0d8a69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.956001:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ce7525c/0xc03b4d103c0d8a69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.956121:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787830029.956132:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000430d52f8/0xc03b4d103c0d8a62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.956144:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b6fd07800 already unused, calling callback (ffffffffc1651420) 00010000:00010000:1.0:1787830029.956150:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000430d52f8/0xc03b4d103c0d8a62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.956161:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000430d52f8/0xc03b4d103c0d8a62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.956184:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000430d52f8/0xc03b4d103c0d8a62 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.956194:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000430d52f8/0xc03b4d103c0d8a62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.957109:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830029.957121:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ce7525c/0xc03b4d103c0d8a69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.957135:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b6fd07e00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:1.0:1787830029.957141:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ce7525c/0xc03b4d103c0d8a69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.957173:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ce7525c/0xc03b4d103c0d8a69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.957192:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ce7525c/0xc03b4d103c0d8a69 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.957206:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830029.957210:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830029.957217:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830029.957542:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787830029.957551:0:15013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ce7525c/0xc03b4d103c0d8a69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.957767:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830029.960715:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787830029.960731:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059daa832/0xc03b4d103c0d8a70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.960752:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1787830029.960758:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830029.960765:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059daa832/0xc03b4d103c0d8a70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.960780:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059daa832/0xc03b4d103c0d8a70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.960793:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059daa832/0xc03b4d103c0d8a70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.960802:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059daa832/0xc03b4d103c0d8a70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.962186:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830029.963009:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830029.963047:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059daa832/0xc03b4d103c0d8a70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.963063:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b6fd07200 already unused, calling callback (ffffffffc1651420) 00010000:00010000:1.0:1787830029.963069:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059daa832/0xc03b4d103c0d8a70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.963081:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059daa832/0xc03b4d103c0d8a70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.963107:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059daa832/0xc03b4d103c0d8a70 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.963116:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059daa832/0xc03b4d103c0d8a70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.963163:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830029.963166:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830029.963168:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787830029.980795:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787830029.980816:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f45cc4fb/0xc03b4d103c0d8a77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.983923:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=409s v=(0 0) 00010000:00010000:1.0:1787830029.983930:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830029.983942:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f45cc4fb/0xc03b4d103c0d8a77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.983964:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f45cc4fb/0xc03b4d103c0d8a77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.983977:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f45cc4fb/0xc03b4d103c0d8a77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.983985:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f45cc4fb/0xc03b4d103c0d8a77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830029.984043:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787830029.987358:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830029.987374:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f45cc4fb/0xc03b4d103c0d8a77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830029.987389:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feee400 already unused, calling callback (ffffffffc1651420) 00010000:00010000:2.0:1787830029.987402:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f45cc4fb/0xc03b4d103c0d8a77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830029.987415:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f45cc4fb/0xc03b4d103c0d8a77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830029.987437:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f45cc4fb/0xc03b4d103c0d8a77 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830029.987446:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f45cc4fb/0xc03b4d103c0d8a77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830029.987469:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830029.987471:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830029.987474:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787830029.987914:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787830029.987924:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5968875/0xc03b4d103c0d8a7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830029.987939:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1787830029.987944:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830029.987950:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5968875/0xc03b4d103c0d8a7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830029.987966:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5968875/0xc03b4d103c0d8a7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830029.987985:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5968875/0xc03b4d103c0d8a7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830029.987992:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5968875/0xc03b4d103c0d8a7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830029.988047:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787830029.988898:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830029.988907:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5968875/0xc03b4d103c0d8a7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.988930:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74898000 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787830029.988935:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5968875/0xc03b4d103c0d8a7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.988944:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5968875/0xc03b4d103c0d8a7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.988966:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5968875/0xc03b4d103c0d8a7e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.988975:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5968875/0xc03b4d103c0d8a7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830029.988996:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830029.988998:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830029.989002:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787830029.990305:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787830029.990317:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d9e4ada/0xc03b4d103c0d8a85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830029.990333:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1787830029.990338:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830029.990344:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d9e4ada/0xc03b4d103c0d8a85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830029.990356:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d9e4ada/0xc03b4d103c0d8a85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830029.990367:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d9e4ada/0xc03b4d103c0d8a85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830029.990375:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d9e4ada/0xc03b4d103c0d8a85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830029.991150:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787830029.991659:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830029.991668:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d9e4ada/0xc03b4d103c0d8a85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830029.991678:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74899800 already unused, calling callback (ffffffffc1651420) 00010000:00010000:2.0:1787830029.991683:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d9e4ada/0xc03b4d103c0d8a85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830029.991694:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d9e4ada/0xc03b4d103c0d8a85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830029.991715:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d9e4ada/0xc03b4d103c0d8a85 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830029.991729:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d9e4ada/0xc03b4d103c0d8a85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830029.991750:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830029.991752:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830029.991753:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787830029.992254:0:15013:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:3.0:1787830029.992373:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f313c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14351:x1874675284145920:12345-0@lo:5:osp-pre-0-0.0 Request processed in 195367us (195929us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830029.992877:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3103c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14351:1874675284145920:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787830029.992906:0:14351:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1787830029.992980:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbef480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14351:1874675284146048:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787830029.993093:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830029.993167:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47ae0840 going to sleep for 11 seconds 00000100:00100000:2.0:1787830029.993431:0:15015:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787830029.993443:0:15015:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787830029.993488:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787830029.993519:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284146048 00000100:00100000:3.0:1787830029.993530:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284146048 00000100:00100000:3.0:1787830029.993586:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787830029.993598:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14351:x1874675284146048:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787830029.993651:0:15013:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1787830030.012097:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14351:x1874675284146048:12345-0@lo:5:osp-pre-0-0.0 Request processed in 18494us (18996us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787830030.012113:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787830030.012187:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbef480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14351:1874675284146048:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787830030.012206:0:14351:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1787830030.116612:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830031.138352:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830032.162174:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787830032.402859:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787830032.402894:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:2.0:1787830033.190769:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830034.210256:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830035.235410:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787830035.298497:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787830035.298505:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787830035.298509:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e9b4f86f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787830035.298518:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 409 00000100:00080000:3.0:1787830035.298525:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787830035.298532:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e9b4f86f000 using connection 192.168.201.151@tcp/0@lo 00000100:00100000:3.0:1787830035.298556:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b7f998b40 x1874675284146432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787830035.298608:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f99b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284146304:0@lo:400:kworker.0 00000100:00100000:3.0:1787830035.298678:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830035.298731:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787830035.298765:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f99a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874675284146560:0@lo:400:kworker.0 00000100:00100000:3.0:1787830035.298793:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830035.298870:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f99b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284146688:0@lo:400:kworker.0 00000100:00100000:1.0:1787830035.298899:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830035.298927:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787830035.298933:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f99ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3278:1874675284146176:0@lo:400:kworker.0 00000100:00100000:1.0:1787830035.298962:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830035.298999:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284146560 00000100:00100000:1.0:1787830035.299007:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284146560 00000100:00100000:1.0:1787830035.299069:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284146688 00000100:00100000:1.0:1787830035.299072:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284146688 00000100:00100000:1.0:1787830035.299100:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787830035.299108:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f998f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874675284146560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830035.299163:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f998f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874675284146560:12345-0@lo:400:kworker.0 Request processed in 56us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830035.299171:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787830035.299187:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787830035.299193:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284146688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830035.299224:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284146688:12345-0@lo:400:kworker.0 Request processed in 31us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830035.299230:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787830035.299247:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284146176 00000100:00100000:1.0:1787830035.299257:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284146176 00000100:00100000:1.0:1787830035.299285:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787830035.299552:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f998b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1874675284146432:0@lo:8:kworker.0 00000100:00100000:0.0:1787830035.299585:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830035.299651:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6f5ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+16:3278:x1874675284146176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830035.299683:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6f5ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+16:3278:x1874675284146176:12345-0@lo:400:kworker.0 Request processed in 392us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830035.299690:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1787830035.299718:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787830035.299789:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f99ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3278:1874675284146176:0@lo:400:kworker.0 00010000:00080000:1.0:1787830035.299804:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b7f99b0c0 x1874675284146688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830035.299817:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f99b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284146688:0@lo:400:kworker.0 00000100:00100000:1.0:1787830035.299836:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787830035.299841:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284146816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787830035.299867:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830035.299900:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284146816 00000100:00100000:1.0:1787830035.299903:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284146816 00000100:00100000:1.0:1787830035.299937:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787830035.299944:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbeda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284146816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787830035.299972:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787830035.300006:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbeda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284146816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830035.300013:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787830035.300049:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787830035.300066:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787830035.300083:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284146816:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787830035.300108:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b7f99a1c0 x1874675284146560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830035.300128:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f99a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874675284146560:0@lo:400:kworker.0 00000100:00100000:2.0:1787830035.301765:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284146304 00000100:00100000:2.0:1787830035.301777:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284146304 00000100:00100000:2.0:1787830035.301822:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284146432 00000100:00100000:2.0:1787830035.301826:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284146432 00000100:00100000:2.0:1787830035.302045:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787830035.302056:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f9992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284146304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830035.302137:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f9992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284146304:12345-0@lo:400:kworker.0 Request processed in 84us (3458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830035.302145:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787830035.302160:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787830035.302165:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f312580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3277:x1874675284146432:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787830035.302182:0:15016:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787830035.306114:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f99b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284146304:0@lo:400:kworker.0 00000100:00100000:2.0:1787830035.335274:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f312580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3277:x1874675284146432:12345-0@lo:8:kworker.0 Request processed in 33081us (35662us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787830035.335351:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787830035.335454:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9e9b4f86f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787830035.335460:0:3277:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787830035.335464:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f998b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1874675284146432:0@lo:8:kworker.0 00010000:00010000:0.0:1787830036.262797:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787830036.713493:0:15732:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787830036.713507:0:15732:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1787830036.713630:0:15732:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e9b7f520000 00000020:01000004:0.0:1787830036.713646:0:15732:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787830036.713660:0:15732:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1787830036.713674:0:15732:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9e9b53918000) 00000020:00000080:0.0:1787830036.713690:0:15732:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787830036.730722:0:15732:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787830036.731005:0:15732:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787830036.732078:0:15732:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787830036.732514:0:15732:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1787830036.732723:0:15732:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787830036.733247:0:15732:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 497: rc = 0 00100000:10000000:1.0:1787830036.733536:0:15732:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 497: rc = 0 00100000:10000000:1.0:1787830036.733632:0:15732:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 497: rc = 0 00100000:10000000:1.0:1787830036.734089:0:15732:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 517: rc = 0 00100000:10000000:1.0:1787830036.734627:0:15732:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 517: rc = 0 00100000:10000000:1.0:1787830036.734895:0:15732:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 517: rc = 0 00100000:10000000:1.0:1787830036.735490:0:15732:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 517: rc = 0 00100000:10000000:1.0:1787830036.735760:0:15732:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 517: rc = 0 00100000:10000000:1.0:1787830036.736048:0:15732:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 517: rc = 0 00000020:00000080:1.0:1787830036.736871:0:15732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787830036.736885:0:15732:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787830036.736898:0:15732:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc03b4d103c0d8a93 00000020:01000004:1.0:1787830036.736908:0:15732:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1787830036.736935:0:15732:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.151@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787830036.736938:0:15732:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787830036.736947:0:15732:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787830036.736976:0:15732:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1787830036.736982:0:15732:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.151@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787830036.747654:0:15732:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.151@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787830036.747696:0:15732:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.151@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787830036.747701:0:15732:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787830036.747702:0:15732:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787830036.747704:0:15732:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787830036.747705:0:15732:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787830036.747706:0:15732:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787830036.747708:0:15732:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787830036.747709:0:15732:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787830036.747711:0:15732:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787830036.747712:0:15732:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787830036.747716:0:15732:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787830036.747719:0:15732:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787830036.747720:0:15732:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787830036.747721:0:15732:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787830036.747722:0:15732:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787830036.747734:0:15732:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787830036.747736:0:15732:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787830036.747737:0:15732:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787830036.747738:0:15732:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787830036.747739:0:15732:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787830036.747772:0:15732:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787830036.747797:0:15732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3130c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284146944:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787830036.747873:0:15732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830036.747977:0:15732:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b431ba600 going to sleep for 11 seconds 00000100:00100000:1.0:1787830036.748055:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284146944 00000100:00100000:1.0:1787830036.748069:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284146944 00000100:00100000:1.0:1787830036.748135:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787830036.748145:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6f5fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+16:15732:x1874675284146944:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787830036.748194:0:14323:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787830036.748197:0:14323:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1787830036.748202:0:14323:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787830036.755069:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6f5fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+16:15732:x1874675284146944:12345-0@lo:253:mount.lustre.0 Request processed in 6914us (7184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830036.755084:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787830036.755304:0:15732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3130c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284146944:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787830036.755407:0:15732:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787830036.755411:0:15732:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787830036.755413:0:15732:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787830036.755414:0:15732:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787830036.755416:0:15732:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787830036.755417:0:15732:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787830036.755419:0:15732:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787830036.755420:0:15732:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787830036.755422:0:15732:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787830036.755423:0:15732:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787830036.755452:0:15732:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e9b7f520000 from lustre-OST0001 10000000:01000000:2.0:1787830036.755479:0:15732:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787830036.755483:0:15732:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787830036.755493:0:15732:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e9b74bf3370 local copy 00010000:00010000:2.0:1787830036.755504:0:15732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b7feefe00/0xc03b4d103c0d8840 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8847 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830036.755756:0:15732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3ccb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284147072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787830036.755800:0:15732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830036.755896:0:15732:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b54200900 going to sleep for 11 seconds 00000100:00100000:1.0:1787830036.755946:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284147072 00000100:00100000:1.0:1787830036.755952:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284147072 00000100:00100000:1.0:1787830036.756001:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787830036.756011:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6f5ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+16:15732:x1874675284147072:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787830036.756573:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6f5ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+16:15732:x1874675284147072:12345-0@lo:501:mount.lustre.0 Request processed in 561us (769us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787830036.756581:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787830036.756650:0:15732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3ccb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284147072:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787830036.756667:0:15732:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787830036.756827:0:15732:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787830036.756836:0:15732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b7feefe00/0xc03b4d103c0d8840 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8847 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830036.756846:0:15732:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b7feefe00/0xc03b4d103c0d8840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8847 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830036.756872:0:15732:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e9b7f520000 10000000:01000000:2.0:1787830036.756884:0:15732:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787830036.756890:0:15732:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787830036.756892:0:15732:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787830036.756897:0:15732:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787830036.756900:0:15732:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787830036.756924:0:15732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3f800/0xc03b4d103c0d8a9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830036.756932:0:15732:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3f800/0xc03b4d103c0d8a9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830036.756942:0:15732:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3f800/0xc03b4d103c0d8a9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830036.756958:0:15732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3ccb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284147200:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787830036.756988:0:15732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830036.757104:0:15732:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b54200900 going to sleep for 11 seconds 00000100:00100000:0.0:1787830036.757181:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284147200 00000100:00100000:0.0:1787830036.757192:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284147200 00000100:00100000:0.0:1787830036.757417:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787830036.757427:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6f5fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+16:15732:x1874675284147200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787830036.757439:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830036.757453:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b6fd06a00/0xc03b4d103c0d8aa1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d8a9a expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830036.757477:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b6fd06a00/0xc03b4d103c0d8aa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d8a9a expref: 17 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830036.757488:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b6fd06a00/0xc03b4d103c0d8aa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d8a9a expref: 17 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830036.757497:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b6fd06a00, rc 0) 00000100:00100000:0.0:1787830036.757541:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6f5fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+17:15732:x1874675284147200:12345-0@lo:101:mount.lustre.0 Request processed in 116us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830036.757548:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787830036.757611:0:15732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3ccb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284147200:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787830036.757625:0:15732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3f800/0xc03b4d103c0d8a9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8aa1 expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830036.757634:0:15732:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3f800/0xc03b4d103c0d8a9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d8aa1 expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787830036.758294:0:15732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787830036.759177:0:15732:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787830036.759409:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787830036.759456:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787830036.759490:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787830036.759538:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787830036.759588:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787830036.759622:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787830036.759684:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787830036.759693:0:15732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787830036.759788:0:15732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3ccb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284147328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787830036.759855:0:15732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830036.760343:0:15732:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b54200600 going to sleep for 11 seconds 00000100:00100000:3.0:1787830036.760499:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284147328 00000100:00100000:3.0:1787830036.760507:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284147328 00000100:00100000:3.0:1787830036.760549:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787830036.760557:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6f5ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+17:15732:x1874675284147328:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787830036.761332:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6f5ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+17:15732:x1874675284147328:12345-0@lo:501:mount.lustre.0 Request processed in 774us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830036.761342:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787830036.761751:0:15732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3ccb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284147328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787830036.761804:0:15732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3ccb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284147456:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787830036.761857:0:15732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830036.761934:0:15732:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b54200600 going to sleep for 11 seconds 00000100:00100000:0.0:1787830036.761968:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284147456 00000100:00100000:0.0:1787830036.761973:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284147456 00000100:00100000:0.0:1787830036.762139:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787830036.762149:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6f5fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+17:15732:x1874675284147456:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787830036.762587:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6f5fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+17:15732:x1874675284147456:12345-0@lo:503:mount.lustre.0 Request processed in 439us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830036.762596:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787830036.762685:0:15732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3ccb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284147456:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787830036.763470:0:15732:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787830036.763542:0:15732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3ccb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284147584:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787830036.763597:0:15732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830036.764199:0:15732:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b54200600 going to sleep for 11 seconds 00000100:00100000:3.0:1787830036.764307:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284147584 00000100:00100000:3.0:1787830036.764323:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284147584 00000100:00100000:0.0:1787830036.764381:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787830036.764393:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6f5fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+17:15732:x1874675284147584:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787830036.764659:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6f5fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+17:15732:x1874675284147584:12345-0@lo:502:mount.lustre.0 Request processed in 268us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830036.764677:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787830036.764895:0:15732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3ccb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284147584:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787830036.765199:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787830036.765266:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787830036.765331:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787830036.765380:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787830036.765416:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787830036.765450:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787830036.765496:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787830036.765530:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787830036.765577:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1787830036.765618:0:15732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3ccb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284147712:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787830036.765683:0:15732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830036.765734:0:15732:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b54200600 going to sleep for 11 seconds 00000100:00100000:1.0:1787830036.766042:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284147712 00000100:00100000:1.0:1787830036.766050:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284147712 00000100:00100000:1.0:1787830036.766090:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787830036.766099:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6f5fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+17:15732:x1874675284147712:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787830036.766339:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6f5fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+17:15732:x1874675284147712:12345-0@lo:502:mount.lustre.0 Request processed in 240us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830036.766347:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787830036.766537:0:15732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3ccb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284147712:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787830036.766625:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787830036.766638:0:15732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1787830036.767737:0:15733:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787830036.767748:0:15733:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787830036.767754:0:15733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830036.767757:0:15733:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787830036.767763:0:15733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787830036.767778:0:15733:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9e9b5205b370) 00000020:00000080:1.0:1787830036.767803:0:15733:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787830036.767808:0:15733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787830036.767879:0:15733:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e9b7f520000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787830036.767887:0:15733:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787830036.767895:0:15733:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc03b4d103c0d8aaf 00010000:00010000:1.0:1787830036.777602:0:15733:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1787830036.778059:0:15733:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1787830036.783861:0:15733:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787830036.798832:0:15733:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787830036.798848:0:15733:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787830036.798855:0:15733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830036.798858:0:15733:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787830036.798862:0:15733:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787830036.798867:0:15733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830036.798869:0:15733:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787830036.798872:0:15733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787830036.798873:0:15733:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787830036.798876:0:15733:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787830036.798878:0:15733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830036.798879:0:15733:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787830036.798881:0:15733:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787830036.798883:0:15733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830036.798884:0:15733:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787830036.798887:0:15733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787830036.798975:0:15733:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787830036.798978:0:15733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830036.798980:0:15733:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787830036.798983:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1787830036.800351:0:15732:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787830036.800393:0:15732:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787830036.800415:0:15732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3f800/0xc03b4d103c0d8a9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8aa1 expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830036.800426:0:15732:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3f800/0xc03b4d103c0d8a9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8aa1 expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830036.800435:0:15732:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9b7f520000 from 1 10000000:01000000:2.0:1787830036.800439:0:15732:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787830036.800477:0:15732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e000/0xc03b4d103c0d8ab6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830036.800486:0:15732:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e000/0xc03b4d103c0d8ab6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830036.800496:0:15732:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e000/0xc03b4d103c0d8ab6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830036.800522:0:15732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3ccb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284147840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787830036.800588:0:15732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830036.800631:0:15732:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b54200000 going to sleep for 11 seconds 00000100:00100000:3.0:1787830036.801108:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284147840 00000100:00100000:3.0:1787830036.801116:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284147840 00000100:00100000:3.0:1787830036.801175:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787830036.801185:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6f5fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+17:15732:x1874675284147840:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787830036.801200:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830036.801216:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b74898400/0xc03b4d103c0d8abd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d8ab6 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830036.801254:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b74898400/0xc03b4d103c0d8abd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d8ab6 expref: 18 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830036.801265:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b74898400/0xc03b4d103c0d8abd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d8ab6 expref: 18 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830036.801273:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74898400, rc 0) 00000100:00100000:3.0:1787830036.801470:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6f5fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+18:15732:x1874675284147840:12345-0@lo:101:mount.lustre.0 Request processed in 285us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830036.801477:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787830036.801531:0:15732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3ccb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284147840:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787830036.801545:0:15732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e000/0xc03b4d103c0d8ab6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8abd expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830036.801554:0:15732:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e000/0xc03b4d103c0d8ab6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d8abd expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787830036.804885:0:15732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787830036.809910:0:15732:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787830036.814358:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787830036.814485:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787830036.814595:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787830036.814605:0:15732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787830036.814708:0:15732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284147968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787830036.814795:0:15732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830036.814844:0:15732:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47ae00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830036.815081:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284147968 00000100:00100000:0.0:1787830036.815088:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284147968 00000100:00100000:0.0:1787830036.815139:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787830036.815148:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6f5fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+18:15732:x1874675284147968:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787830036.817553:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6f5fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+18:15732:x1874675284147968:12345-0@lo:501:mount.lustre.0 Request processed in 2397us (2749us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830036.817566:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787830036.817811:0:15732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284147968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787830036.817859:0:15732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284148096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787830036.817913:0:15732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830036.817946:0:15732:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47ae00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830036.817997:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284148096 00000100:00100000:0.0:1787830036.818004:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284148096 00000100:00100000:0.0:1787830036.818077:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787830036.818087:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+18:15732:x1874675284148096:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787830036.818700:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+18:15732:x1874675284148096:12345-0@lo:503:mount.lustre.0 Request processed in 612us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830036.818709:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787830036.823525:0:15732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284148096:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787830036.824878:0:15732:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787830036.824971:0:15732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284148224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787830036.825082:0:15732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830036.825122:0:15732:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47ae00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830036.825282:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284148224 00000100:00100000:2.0:1787830036.825288:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284148224 00000100:00100000:2.0:1787830036.825466:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787830036.825477:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+18:15732:x1874675284148224:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787830036.825714:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+18:15732:x1874675284148224:12345-0@lo:502:mount.lustre.0 Request processed in 238us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830036.825736:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787830036.825854:0:15732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284148224:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787830036.826173:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787830036.826238:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787830036.826292:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787830036.826513:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787830036.826552:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787830036.826602:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787830036.826639:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787830036.826672:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787830036.826708:0:15732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284148352:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787830036.826783:0:15732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830036.826826:0:15732:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47ae00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830036.827095:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284148352 00000100:00100000:2.0:1787830036.827101:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284148352 00000100:00100000:2.0:1787830036.827151:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787830036.827160:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+18:15732:x1874675284148352:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787830036.827578:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+18:15732:x1874675284148352:12345-0@lo:502:mount.lustre.0 Request processed in 418us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830036.827587:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787830036.827677:0:15732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284148352:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787830036.827797:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787830036.827809:0:15732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787830036.832663:0:15737:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787830036.832676:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830036.832679:0:15737:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787830036.832686:0:15737:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e9b7f520000 00000020:00000080:2.0:1787830036.832689:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787830036.832697:0:15737:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787830036.832700:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830036.832702:0:15737:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787830036.832704:0:15737:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787830036.832707:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830036.832709:0:15737:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787830036.832712:0:15737:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e9b7f520000 00000020:00000080:2.0:1787830036.832715:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787830036.832835:0:15737:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787830036.832839:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830036.832841:0:15737:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787830036.832844:0:15737:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787830036.832846:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830036.832860:0:15737:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787830036.832866:0:15737:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e9b7f520000 00000020:00000080:2.0:1787830036.832868:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787830036.836364:0:15737:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787830036.836377:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830036.836380:0:15737:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787830036.836385:0:15737:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787830036.836718:0:15732:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787830036.836760:0:15732:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787830036.836785:0:15732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e000/0xc03b4d103c0d8ab6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8abd expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830036.836797:0:15732:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e000/0xc03b4d103c0d8ab6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8abd expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830036.836855:0:15732:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787830036.836859:0:15732:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e9b7f520000 10000000:01000000:3.0:1787830036.836862:0:15732:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e9b7f520000 10000000:01000000:3.0:1787830036.836866:0:15732:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787830036.836872:0:15732:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e9b7f520000 from 1 10000000:01000000:3.0:1787830036.836874:0:15732:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787830036.836910:0:15732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74899400/0xc03b4d103c0d8ac4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830036.836919:0:15732:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b74899400/0xc03b4d103c0d8ac4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830036.836930:0:15732:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b74899400/0xc03b4d103c0d8ac4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830036.836957:0:15732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284148480:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787830036.837061:0:15732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830036.837097:0:15732:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47ae0180 going to sleep for 11 seconds 00000100:00100000:3.0:1787830036.837118:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284148480 00000100:00100000:3.0:1787830036.837136:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284148480 00000100:00100000:3.0:1787830036.837177:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787830036.837186:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+18:15732:x1874675284148480:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787830036.837199:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830036.837211:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b74899200/0xc03b4d103c0d8acb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d8ac4 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830036.838238:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b74899200/0xc03b4d103c0d8acb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d8ac4 expref: 19 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830036.838254:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b74899200/0xc03b4d103c0d8acb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d8ac4 expref: 19 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830036.838262:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74899200, rc 0) 00000100:00100000:3.0:1787830036.838458:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:15732:x1874675284148480:12345-0@lo:101:mount.lustre.0 Request processed in 1272us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830036.838467:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787830036.838537:0:15732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284148480:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787830036.838556:0:15732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b74899400/0xc03b4d103c0d8ac4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8acb expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830036.838566:0:15732:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b74899400/0xc03b4d103c0d8ac4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d8acb expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787830036.839708:0:15732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1787830036.842395:0:15732:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787830036.842770:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787830036.842818:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787830036.842851:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787830036.842900:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787830036.842935:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787830036.842985:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787830036.843049:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787830036.843087:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787830036.846515:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787830036.846619:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787830036.846657:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787830036.846717:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787830036.847388:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787830036.847435:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787830036.847498:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787830036.847557:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787830036.847591:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787830036.847643:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787830036.847679:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787830036.847713:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787830036.847777:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787830036.847823:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787830036.847862:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787830036.847913:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787830036.847951:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787830036.847984:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787830036.848072:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787830036.848110:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787830036.853184:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787830036.853705:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1787830036.853786:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1787830036.853843:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1787830036.853888:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1787830036.853941:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1787830036.853981:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1787830036.854068:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1787830036.854106:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1787830036.854208:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1787830036.854217:0:15732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1787830036.856035:0:15732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284148608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787830036.856117:0:15732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830036.856167:0:15732:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47ae0180 going to sleep for 11 seconds 00000100:00100000:2.0:1787830036.856367:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284148608 00000100:00100000:2.0:1787830036.856377:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284148608 00000100:00100000:2.0:1787830036.856439:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787830036.856449:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:15732:x1874675284148608:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787830036.856708:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:15732:x1874675284148608:12345-0@lo:501:mount.lustre.0 Request processed in 259us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830036.856716:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787830036.857487:0:15732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284148608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787830036.857535:0:15732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284148736:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787830036.857586:0:15732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830036.857617:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284148736 00000100:00100000:3.0:1787830036.857623:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284148736 00000100:00100000:3.0:1787830036.857657:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787830036.857665:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:15732:x1874675284148736:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787830036.857987:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:15732:x1874675284148736:12345-0@lo:503:mount.lustre.0 Request processed in 322us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830036.857996:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787830036.858053:0:15732:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47ae0180 going to sleep for 11 seconds 00000100:00100000:3.0:1787830036.858066:0:15732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284148736:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787830036.858761:0:15732:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787830036.858838:0:15732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284148864:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787830036.858888:0:15732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830036.858928:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284148864 00000100:00100000:3.0:1787830036.858939:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284148864 00000100:00100000:3.0:1787830036.858969:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787830036.858977:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:15732:x1874675284148864:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787830036.863887:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:15732:x1874675284148864:12345-0@lo:502:mount.lustre.0 Request processed in 4899us (4988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830036.863904:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787830036.863995:0:15732:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47ae0180 going to sleep for 11 seconds 00000100:00100000:3.0:1787830036.864036:0:15732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284148864:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787830036.864383:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787830036.864451:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787830036.864481:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787830036.864519:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787830036.864549:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787830036.864588:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787830036.864627:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787830036.864654:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787830036.864692:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787830036.864721:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787830036.864771:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787830036.864810:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787830036.864839:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787830036.864867:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787830036.864917:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787830036.864948:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787830036.864974:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787830036.865010:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787830036.865069:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787830036.865096:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787830036.865133:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787830036.865170:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787830036.865222:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787830036.865272:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787830036.865305:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787830036.865339:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787830036.865387:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787830036.865424:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787830036.865456:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787830036.865503:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787830036.865537:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787830036.865568:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787830036.865597:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787830036.865641:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787830036.865673:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787830036.865716:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787830036.870194:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787830036.870295:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787830036.870396:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787830036.870434:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787830036.870489:0:15732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284148992:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787830036.870589:0:15732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830036.870652:0:15732:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47ae0180 going to sleep for 11 seconds 00000100:00100000:2.0:1787830036.870742:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284148992 00000100:00100000:2.0:1787830036.870749:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284148992 00000100:00100000:2.0:1787830036.870805:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787830036.870815:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:15732:x1874675284148992:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787830036.871086:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:15732:x1874675284148992:12345-0@lo:502:mount.lustre.0 Request processed in 272us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830036.871095:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787830036.875302:0:15732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284148992:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787830036.875457:0:15732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787830036.875474:0:15732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787830036.887657:0:15742:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787830036.887675:0:15742:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9e9b520599b8) 00000020:00000080:1.0:1787830036.887700:0:15742:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1787830036.887804:0:15742:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e9b7f520000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787830036.887809:0:15742:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e9b7f520000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787830036.887812:0:15742:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e9b7f520000 3 00010000:00080000:1.0:1787830036.887844:0:15742:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e9a41377800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.151@tcp at head 00010000:00010000:1.0:1787830036.891836:0:15742:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1787830036.892093:0:15742:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787830036.892138:0:15742:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787830036.892156:0:15742:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc03b4d103c0d8ad9 00000100:00080000:1.0:1787830036.892169:0:15742:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787830036.892178:0:15742:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e9a41377800 using connection 192.168.201.151@tcp/0@lo 00000100:00100000:1.0:1787830036.892217:0:15742:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b7fbede00 x1874675284149120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787830036.892245:0:15742:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787830036.892401:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1874675284149120:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787830036.892482:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830036.892556:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284149120 00000100:00100000:3.0:1787830036.892563:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284149120 00000100:00100000:3.0:1787830036.892598:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787830036.892606:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f999680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3277:x1874675284149120:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787830036.892638:0:14330:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 416 last 0 00000020:00000080:3.0:1787830036.892676:0:14330:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc03b4d103c0d8ae0 00000004:00100000:3.0:1787830036.892691:0:14330:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787830036.892738:0:14330:0:(import.c:65:import_set_state_nolock()) ffff9e9b52057800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787830036.892791:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f999680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1874675284149120:12345-0@lo:38:llog_process_th.0 Request processed in 183us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830036.892798:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787830036.892837:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b7fbede00 x1874675284149120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787830046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830036.892847:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787830036.892855:0:3277:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1787830036.892862:0:3277:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787830036.892866:0:3277:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787830036.892868:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9e9a41377800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787830036.892873:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1874675284149120:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787830036.895899:0:15742:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00080000:2.0:1787830036.900668:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787830036.900674:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787830036.900678:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e9b4f86f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787830036.900687:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 415 00000100:00080000:2.0:1787830036.900691:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787830036.900698:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e9b4f86f000 using connection 192.168.201.151@tcp/0@lo 00000100:00100000:2.0:1787830036.900732:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b7f3cc780 x1874675284149376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787830036.900820:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1874675284149376:0@lo:8:kworker.0 00000100:00100000:2.0:1787830036.900904:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830036.900948:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787830036.900956:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1874675284149632:0@lo:400:kworker.0 00000100:00100000:2.0:1787830036.900988:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830036.901079:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284149632 00000100:00100000:2.0:1787830036.901085:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284149632 00000100:00100000:2.0:1787830036.901131:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787830036.901142:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1874675284149632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830036.901192:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1874675284149632:12345-0@lo:400:kworker.0 Request processed in 51us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830036.901199:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1787830036.901245:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b7f3ce940 x1874675284149632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830036.901259:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1874675284149632:0@lo:400:kworker.0 00000100:00100000:0.0:1787830036.901489:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284149248:0@lo:400:kworker.0 00000100:00100000:0.0:1787830036.901523:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830036.901555:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787830036.901562:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874675284149504:0@lo:400:kworker.0 00000100:00100000:0.0:1787830036.901585:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830036.901625:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284149504 00000100:00100000:0.0:1787830036.901630:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284149504 00000100:00100000:0.0:1787830036.901658:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787830036.901666:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f310f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874675284149504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830036.901701:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f310f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874675284149504:12345-0@lo:400:kworker.0 Request processed in 36us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830036.901717:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787830036.901757:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9b7f3cda40 x1874675284149504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830036.901768:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874675284149504:0@lo:400:kworker.0 00000100:00100000:3.0:1787830036.901854:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284149376 00000100:00100000:3.0:1787830036.901859:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284149376 00000100:00100000:3.0:1787830036.901888:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284149248 00000100:00100000:3.0:1787830036.901891:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284149248 00000100:00100000:3.0:1787830036.901929:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787830036.901937:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f311a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284149248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830036.901975:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f311a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284149248:12345-0@lo:400:kworker.0 Request processed in 39us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830036.901982:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787830036.901995:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787830036.902000:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3277:x1874675284149376:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787830036.902071:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3277:x1874675284149376:12345-0@lo:8:kworker.0 Request processed in 69us (1167us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787830036.902078:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000000:3.0:1787830036.902115:0:15732:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787830036.902152:0:15732:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787830036.902164:0:15732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74899400/0xc03b4d103c0d8ac4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8acb expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830036.902174:0:15732:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b74899400/0xc03b4d103c0d8ac4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8acb expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787830036.902220:0:15732:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787830036.902222:0:15732:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787830036.902224:0:15732:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787830036.902225:0:15732:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787830036.902226:0:15732:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787830036.902228:0:15732:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787830036.902230:0:15732:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787830036.902231:0:15732:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787830036.902371:0:15732:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787830036.902375:0:15732:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787830036.902377:0:15732:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787830036.902379:0:15732:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787830036.902381:0:15732:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787830036.902382:0:15732:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787830036.902383:0:15732:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787830036.902384:0:15732:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787830036.902385:0:15732:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787830036.902387:0:15732:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787830036.902388:0:15732:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787830036.902406:0:15732:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787830036.902417:0:15732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284149760:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787830036.902453:0:15732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830036.902481:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284149760 00000100:00100000:3.0:1787830036.902490:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284149760 00000100:00100000:3.0:1787830036.902515:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787830036.902521:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:15732:x1874675284149760:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787830036.902541:0:14322:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787830036.902554:0:14322:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787830036.903043:0:15732:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47ae00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830036.903425:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284149248:0@lo:400:kworker.0 00000100:00100000:2.0:1787830036.903529:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787830036.903538:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9e9b4f86f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787830036.903542:0:3277:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787830036.903546:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1874675284149376:0@lo:8:kworker.0 00000040:00080000:0.0:1787830036.908175:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 20000000:01000000:3.0:1787830036.955160:0:14322:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787830036.955183:0:14322:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787830036.955246:0:14344:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787830036.955251:0:14344:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787830036.955280:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e9b74e3e400/0xc03b4d103c0d8ae7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830036.955299:0:14344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b7feee600/0xc03b4d103c0d89c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d89ba expref: 19 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830036.955320:0:14344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e9b74e3e400/0xc03b4d103c0d8ae7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830036.955364:0:14344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b7feee600/0xc03b4d103c0d89c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d89ba expref: 19 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830036.955377:0:14344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9b7feee600/0xc03b4d103c0d89c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d89ba expref: 19 pid: 14322 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830036.955392:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3cc780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14344:1874675284149888:0@lo:104: 00000100:00100000:2.0:1787830036.955458:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830036.955506:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b54200900 going to sleep for 11 seconds 00000100:00100000:3.0:1787830036.956490:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284149888 00000100:00100000:3.0:1787830036.956503:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284149888 00000100:00100000:3.0:1787830036.956557:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787830036.956569:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3ce940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+3:14344:x1874675284149888:12345-0@lo:104: 00010000:00010000:3.0:1787830036.956585:0:14312:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b74899a00/0xc03b4d103c0d89ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d89c1 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830036.956664:0:14312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787830036.956671:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3ce940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+3:14344:x1874675284149888:12345-0@lo:104: Request processed in 105us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830036.956679:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787830036.956776:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3cc780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14344:1874675284149888:0@lo:104: 00010000:00010000:2.0:1787830036.956799:0:14344:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e9b74e3e400/0xc03b4d103c0d8ae7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830036.958454:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830036.958465:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b74899a00/0xc03b4d103c0d89ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d89c1 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830036.958476:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74899a00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:1.0:1787830036.958481:0:14317:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b74899a00/0xc03b4d103c0d89ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d89c1 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830036.958506:0:14317:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b74899a00/0xc03b4d103c0d89ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d89c1 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787830036.958513:0:14317:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b74899a00/0xc03b4d103c0d89ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d89c1 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830036.958520:0:14317:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787830036.958580:0:14317:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b74899a00/0xc03b4d103c0d89ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d89c1 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830036.958588:0:14317:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787830036.958617:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b74899a00/0xc03b4d103c0d89ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d89c1 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830036.958626:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b74899a00/0xc03b4d103c0d89ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d89c1 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830036.958644:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830036.958646:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830036.958648:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830036.958657:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787830036.958675:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fbecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3278:1874675284150016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787830036.958750:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830036.958800:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284150016 00000100:00100000:1.0:1787830036.958807:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284150016 00010000:00010000:1.0:1787830036.958835:0:14313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b7feee600/0xc03b4d103c0d89c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d89ba expref: 20 pid: 14322 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830036.958865:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787830036.958879:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbeed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+20:3278:x1874675284150016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787830036.958892:0:14313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830036.958898:0:14313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b7feee600/0xc03b4d103c0d89c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d89ba expref: 20 pid: 14322 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830036.958910:0:14313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b7feee600/0xc03b4d103c0d89c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d89ba expref: 20 pid: 14322 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830036.958926:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b7feee600/0xc03b4d103c0d89c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d89ba expref: 20 pid: 14322 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830036.958942:0:14313:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e9b74e3e400/0xc03b4d103c0d8ae7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830036.958952:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b74e3e400/0xc03b4d103c0d8ae7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787830036.958970:0:14313:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003718944s 00010000:00010000:1.0:1787830036.958976:0:14313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b74e3e400/0xc03b4d103c0d8ae7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830036.958984:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b74e3e400/0xc03b4d103c0d8ae7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830036.958992:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e9b74e3e400/0xc03b4d103c0d8ae7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830036.959000:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e9b74e3e400/0xc03b4d103c0d8ae7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830036.959006:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3e400 already unused, calling callback (ffffffffc1651420) 00010000:00010000:1.0:1787830036.959051:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e9b74e3e400/0xc03b4d103c0d8ae7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830036.959061:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e9b74e3e400/0xc03b4d103c0d8ae7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830036.959079:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e9b74e3e400/0xc03b4d103c0d8ae7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830036.959091:0:14313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787830036.959123:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbeed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:3278:x1874675284150016:12345-0@lo:103:ldlm_bl.0 Request processed in 245us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830036.959131:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787830036.959167:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fbecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3278:1874675284150016:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787830036.959561:0:14344:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e9b74e3e400/0xc03b4d103c0d8ae7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830036.959570:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e9b74e3e400/0xc03b4d103c0d8ae7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830036.959575:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b74e3e400/0xc03b4d103c0d8ae7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830036.963583:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+18:15732:x1874675284149760:12345-0@lo:253:mount.lustre.0 Request processed in 61051us (61118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830036.963599:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787830036.963702:0:15732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:15732:1874675284149760:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787830036.963718:0:15732:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787830036.963734:0:15732:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787830036.963736:0:15732:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787830036.963737:0:15732:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787830036.963738:0:15732:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787830036.963739:0:15732:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787830036.963741:0:15732:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787830036.963742:0:15732:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787830036.963744:0:15732:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787830036.963745:0:15732:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787830036.963761:0:15732:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787830036.968364:0:15732:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787830036.968556:0:15732:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787830036.968705:0:15732:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787830036.968861:0:15732:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787830036.969005:0:15732:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787830036.969252:0:15732:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787830036.970745:0:15732:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787830037.019118:0:15732:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787830037.019128:0:15732:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787830037.019165:0:15732:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787830037.019346:0:15732:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787830037.019364:0:15732:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787830037.019396:0:15732:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787830037.283753:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830038.313301:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787830038.313364:0:14325:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787830038.313368:0:14325:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e9b44e11000 from 8 10000000:01000000:2.0:1787830038.313374:0:14325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787830038.313420:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ea00/0xc03b4d103c0d8aee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830038.313442:0:14325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ea00/0xc03b4d103c0d8aee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830038.313454:0:14325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ea00/0xc03b4d103c0d8aee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830038.313482:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3cc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284150144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787830038.313553:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830038.313611:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b69e3e480 going to sleep for 11 seconds 00000100:00100000:3.0:1787830038.316248:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284150144 00000100:00100000:3.0:1787830038.316263:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284150144 00000100:00100000:3.0:1787830038.316333:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787830038.316342:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+18:14325:x1874675284150144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787830038.316358:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830038.316378:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b74899e00/0xc03b4d103c0d8af5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d8aee expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830038.316405:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b74899e00/0xc03b4d103c0d8af5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d8aee expref: 19 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830038.316415:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b74899e00/0xc03b4d103c0d8af5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d8aee expref: 19 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830038.316423:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b74899e00, rc 0) 00000100:00100000:3.0:1787830038.316502:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:14325:x1874675284150144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (2949us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830038.316508:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787830038.316567:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3cc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284150144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787830038.316601:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ea00/0xc03b4d103c0d8aee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8af5 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830038.316625:0:14325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ea00/0xc03b4d103c0d8aee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d8af5 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830038.316714:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f9983c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284150272:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787830038.316756:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830038.316785:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b601e06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787830038.316846:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284150272 00000100:00100000:1.0:1787830038.316852:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284150272 00000100:00100000:1.0:1787830038.316887:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787830038.316895:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:14325:x1874675284150272:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787830038.316909:0:14321:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787830038.316926:0:14321:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787830038.316929:0:14321:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1787830038.318088:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f9983c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284150272:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787830038.324194:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:14325:x1874675284150272:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 7119us (7257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830038.324213:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 10000000:01000000:3.0:1787830038.329249:0:14325:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787830038.329264:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ea00/0xc03b4d103c0d8aee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8af5 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830038.329276:0:14325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3ea00/0xc03b4d103c0d8aee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8af5 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830039.338344:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830040.355443:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830040.422255:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787830040.422280:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284150400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787830040.422353:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830040.422420:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284150400 00000100:00100000:2.0:1787830040.422427:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284150400 00000100:00100000:2.0:1787830040.422482:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787830040.422491:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284150400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787830040.422530:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787830040.422579:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284150400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830040.422586:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787830040.422604:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787830040.422648:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284150400:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787830041.381723:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787830041.957146:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787830041.957155:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787830041.957160:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e9b4f86f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787830041.957177:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e9b4f86f000 using connection 192.168.201.151@tcp/0@lo 00000100:00100000:3.0:1787830041.957205:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b7f998780 x1874675284150784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787830041.957294:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f998b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874675284150912:0@lo:400:kworker.0 00000100:00100000:3.0:1787830041.957395:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830041.957489:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787830041.957495:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284150656:0@lo:400:kworker.0 00000100:00100000:3.0:1787830041.957545:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830041.957684:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f998780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1874675284150784:0@lo:8:kworker.0 00000100:00100000:3.0:1787830041.957712:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830041.957749:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284150912 00000100:00100000:3.0:1787830041.957757:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284150912 00000100:00100000:3.0:1787830041.957817:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787830041.957826:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f99b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1874675284150912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830041.957884:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f99b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1874675284150912:12345-0@lo:400:kworker.0 Request processed in 58us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830041.957892:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787830041.957919:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284150656 00000100:00100000:3.0:1787830041.957922:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284150656 00000100:00100000:3.0:1787830041.957949:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284150784 00000100:00100000:3.0:1787830041.957952:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284150784 00000100:00100000:3.0:1787830041.957971:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787830041.957978:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f99ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284150656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830041.958010:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f99ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284150656:12345-0@lo:400:kworker.0 Request processed in 33us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830041.958050:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787830041.958062:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787830041.958066:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3277:x1874675284150784:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787830041.958094:0:15013:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 421 last 0 00000100:00100000:2.0:1787830041.958587:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f999a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3281:1874675284150528:0@lo:400:kworker.0 00000100:00100000:2.0:1787830041.958647:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830041.958725:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f99b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284151040:0@lo:400:kworker.0 00000100:00100000:1.0:1787830041.958768:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830041.958816:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284151040 00000100:00100000:1.0:1787830041.958821:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284151040 00000100:00100000:1.0:1787830041.958866:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787830041.958873:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284151040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830041.958915:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284151040:12345-0@lo:400:kworker.0 Request processed in 44us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830041.958922:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1787830041.958941:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1787830041.958953:0:15013:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc03b4d103c0d8afc 00002000:00100000:3.0:1787830041.958973:0:15013:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e9b50d56800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113940 ocd_grant: 0 ocd_index: 1 ocd_group 0 00010000:00080000:1.0:1787830041.958974:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f99b840 x1874675284151040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1787830041.958977:0:15013:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787830041.958981:0:15013:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1787830041.958990:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f99b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284151040:0@lo:400:kworker.0 00002000:00080000:3.0:1787830041.959473:0:15013:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787830041.959506:0:15013:0:(import.c:65:import_set_state_nolock()) ffff9e9b50d55000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787830041.959570:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3277:x1874675284150784:12345-0@lo:8:kworker.0 Request processed in 1501us (1856us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830041.959578:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787830041.959646:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284150656:0@lo:400:kworker.0 00010000:00080000:3.0:1787830041.959662:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f998b40 x1874675284150912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830041.959673:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f998b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874675284150912:0@lo:400:kworker.0 00010000:00080000:1.0:1787830041.959761:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f998780 x1874675284150784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787830066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787830041.959777:0:3277:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787830041.959787:0:3277:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787830041.959794:0:3277:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787830041.959797:0:3277:0:(import.c:65:import_set_state_nolock()) ffff9e9b4f86f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787830041.959817:0:3277:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787830041.959824:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f998780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1874675284150784:0@lo:8:kworker.0 00000004:00080000:3.0:1787830041.959999:0:14353:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1787830041.960045:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fe79680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14353:1874675284151424:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787830041.960082:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830041.960162:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b587ba180 going to sleep for 11 seconds 00000004:00080000:3.0:1787830041.960182:0:14352:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1787830041.960268:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fe78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284151296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787830041.960300:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830041.960337:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284151296 00000100:00100000:1.0:1787830041.960344:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284151296 00000100:00100000:1.0:1787830041.960403:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787830041.960412:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1874675284151296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787830041.960440:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787830041.960494:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1874675284151296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830041.960500:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787830041.960519:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787830041.960539:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7fe78000 x1874675284151296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830041.960554:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fe78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284151296:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1787830041.962901:0:14352:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 421863880149ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787830041.962999:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284151424 00000100:00100000:3.0:1787830041.963012:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284151424 00000100:00100000:3.0:1787830041.963092:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787830041.968786:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f99a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1874675284151168:0@lo:400:kworker.0 00000100:00100000:2.0:1787830041.968912:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830041.969382:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14353:x1874675284151424:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787830041.973837:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284150528 00000100:00100000:0.0:1787830041.973857:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284150528 00000100:00100000:0.0:1787830041.973938:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787830041.973950:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:3281:x1874675284150528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830041.974094:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:3281:x1874675284150528:12345-0@lo:400:kworker.0 Request processed in 147us (15446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830041.975586:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787830041.979160:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284151168 00000100:00100000:1.0:1787830041.979179:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284151168 00000100:00100000:1.0:1787830041.979578:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787830041.979592:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874675284151168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830041.979727:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874675284151168:12345-0@lo:400:kworker.0 Request processed in 138us (10815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830041.979736:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787830041.979765:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:3.0:1787830041.979832:0:15013:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787830041.979842:0:15013:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1787830041.979848:0:15013:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000100:00100000:0.0:1787830041.982352:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f999a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3281:1874675284150528:0@lo:400:kworker.0 00010000:00080000:0.0:1787830041.982387:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f99a1c0 x1874675284151168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830041.982402:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f99a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1874675284151168:0@lo:400:kworker.0 00002000:00010000:3.0:1787830042.000835:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787830042.000854:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000051eaa92/0xc03b4d103c0d8b03 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.000881:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1787830042.000886:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830042.000904:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000051eaa92/0xc03b4d103c0d8b03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.000927:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000051eaa92/0xc03b4d103c0d8b03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.000942:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000051eaa92/0xc03b4d103c0d8b03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.000951:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000051eaa92/0xc03b4d103c0d8b03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.000979:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787830042.001580:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787830042.001588:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093eff740/0xc03b4d103c0d8b0a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.001600:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1787830042.001604:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830042.001609:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093eff740/0xc03b4d103c0d8b0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.001620:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093eff740/0xc03b4d103c0d8b0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.001628:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093eff740/0xc03b4d103c0d8b0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.001662:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093eff740/0xc03b4d103c0d8b0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.004665:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787830042.004708:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787830042.004720:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000051eaa92/0xc03b4d103c0d8b03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.004738:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74899a00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:3.0:1787830042.004744:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000051eaa92/0xc03b4d103c0d8b03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.004757:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000051eaa92/0xc03b4d103c0d8b03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.004783:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000051eaa92/0xc03b4d103c0d8b03 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.004792:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000051eaa92/0xc03b4d103c0d8b03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.004817:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787830042.004821:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093eff740/0xc03b4d103c0d8b0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.004842:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74898e00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:3.0:1787830042.004845:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093eff740/0xc03b4d103c0d8b0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.004853:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093eff740/0xc03b4d103c0d8b0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.004864:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093eff740/0xc03b4d103c0d8b0a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.004871:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093eff740/0xc03b4d103c0d8b0a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.004885:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830042.004886:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830042.004888:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830042.005626:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787830042.008772:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787830042.008789:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d9e4ada/0xc03b4d103c0d8b11 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.008811:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1787830042.008816:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830042.008825:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d9e4ada/0xc03b4d103c0d8b11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.008842:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d9e4ada/0xc03b4d103c0d8b11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.008865:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d9e4ada/0xc03b4d103c0d8b11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.008873:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d9e4ada/0xc03b4d103c0d8b11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.008904:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787830042.010406:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830042.010447:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d9e4ada/0xc03b4d103c0d8b11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.010464:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74899800 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787830042.010469:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d9e4ada/0xc03b4d103c0d8b11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.010482:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d9e4ada/0xc03b4d103c0d8b11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.010512:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d9e4ada/0xc03b4d103c0d8b11 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.010520:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d9e4ada/0xc03b4d103c0d8b11 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.010548:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830042.010550:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830042.010552:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787830042.012832:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787830042.012848:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5968875/0xc03b4d103c0d8b18 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.012870:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1787830042.012875:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830042.012883:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5968875/0xc03b4d103c0d8b18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.012900:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5968875/0xc03b4d103c0d8b18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.012911:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5968875/0xc03b4d103c0d8b18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.012919:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5968875/0xc03b4d103c0d8b18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.013117:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787830042.015003:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787830042.015042:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008850a82e/0xc03b4d103c0d8b1f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.015063:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1787830042.015068:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830042.015075:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008850a82e/0xc03b4d103c0d8b1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.015092:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008850a82e/0xc03b4d103c0d8b1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.018163:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008850a82e/0xc03b4d103c0d8b1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830042.018178:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008850a82e/0xc03b4d103c0d8b1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.022309:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787830042.022329:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5968875/0xc03b4d103c0d8b18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.022345:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74898000 already unused, calling callback (ffffffffc1651420) 00010000:00010000:1.0:1787830042.022350:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5968875/0xc03b4d103c0d8b18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.022388:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5968875/0xc03b4d103c0d8b18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.022432:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5968875/0xc03b4d103c0d8b18 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.022440:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5968875/0xc03b4d103c0d8b18 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.022558:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830042.022564:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008850a82e/0xc03b4d103c0d8b1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.022571:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40031400 already unused, calling callback (ffffffffc1651420) 00010000:00010000:1.0:1787830042.022575:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008850a82e/0xc03b4d103c0d8b1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.022584:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008850a82e/0xc03b4d103c0d8b1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.022595:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008850a82e/0xc03b4d103c0d8b1f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.022603:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830042.022604:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830042.022611:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830042.033343:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787830042.033365:0:15013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008850a82e/0xc03b4d103c0d8b1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787830042.034456:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787830042.034468:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b8f3c8a/0xc03b4d103c0d8b26 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.034489:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787830042.034494:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830042.034503:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b8f3c8a/0xc03b4d103c0d8b26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.034523:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b8f3c8a/0xc03b4d103c0d8b26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.034536:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b8f3c8a/0xc03b4d103c0d8b26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.034543:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b8f3c8a/0xc03b4d103c0d8b26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.034564:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787830042.035000:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787830042.035008:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8b2d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.035098:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787830042.035110:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830042.035115:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8b2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.035125:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8b2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.035135:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8b2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.035143:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8b2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.035152:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787830042.035564:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787830042.035570:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005df613b3/0xc03b4d103c0d8b34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.035578:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787830042.035581:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830042.035585:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005df613b3/0xc03b4d103c0d8b34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.035593:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005df613b3/0xc03b4d103c0d8b34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.035601:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005df613b3/0xc03b4d103c0d8b34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.035616:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005df613b3/0xc03b4d103c0d8b34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.035623:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1787830042.036097:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787830042.036104:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1299e02/0xc03b4d103c0d8b3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.036114:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787830042.036117:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830042.036122:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1299e02/0xc03b4d103c0d8b3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.036131:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1299e02/0xc03b4d103c0d8b3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.036140:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1299e02/0xc03b4d103c0d8b3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.036148:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1299e02/0xc03b4d103c0d8b3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.036157:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1787830042.038688:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787830042.038710:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8b42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.038755:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787830042.038760:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830042.038769:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8b42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.038785:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8b42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.038799:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8b42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.038808:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8b42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.038864:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1787830042.039118:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787830042.039127:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b8f3c8a/0xc03b4d103c0d8b26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.039137:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3e200 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787830042.039141:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b8f3c8a/0xc03b4d103c0d8b26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.039163:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b8f3c8a/0xc03b4d103c0d8b26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.039186:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b8f3c8a/0xc03b4d103c0d8b26 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.039194:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b8f3c8a/0xc03b4d103c0d8b26 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.039351:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787830042.039356:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8b2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.039365:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f600 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787830042.039368:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8b2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.039376:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8b2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.039387:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8b2d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.039394:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8b2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.039417:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787830042.039495:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005df613b3/0xc03b4d103c0d8b34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.039505:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3fe00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787830042.039508:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005df613b3/0xc03b4d103c0d8b34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.039517:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005df613b3/0xc03b4d103c0d8b34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.039528:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005df613b3/0xc03b4d103c0d8b34 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.039536:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005df613b3/0xc03b4d103c0d8b34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.039549:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787830042.039552:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1299e02/0xc03b4d103c0d8b3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.039559:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3e400 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787830042.039562:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1299e02/0xc03b4d103c0d8b3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.039580:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1299e02/0xc03b4d103c0d8b3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.039591:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1299e02/0xc03b4d103c0d8b3b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.039598:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1299e02/0xc03b4d103c0d8b3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.039611:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830042.039615:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8b42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.039622:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3ee00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787830042.039624:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8b42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787830042.040066:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787830042.040074:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035f87f2e/0xc03b4d103c0d8b49 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.040086:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787830042.040091:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830042.040096:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035f87f2e/0xc03b4d103c0d8b49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.040106:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035f87f2e/0xc03b4d103c0d8b49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.040124:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035f87f2e/0xc03b4d103c0d8b49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.040132:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035f87f2e/0xc03b4d103c0d8b49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.040140:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830042.041888:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1787830042.043845:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787830042.043851:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8b42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.043861:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000324f7c36/0xc03b4d103c0d8b50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.043877:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787830042.043882:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830042.043889:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8b42 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.043899:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8b42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.044275:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830042.044278:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830042.044281:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830042.044799:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000324f7c36/0xc03b4d103c0d8b50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.044823:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000324f7c36/0xc03b4d103c0d8b50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.044834:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000324f7c36/0xc03b4d103c0d8b50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.044842:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000324f7c36/0xc03b4d103c0d8b50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.052045:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787830042.054833:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787830042.054851:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004da18a5b/0xc03b4d103c0d8b57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.054874:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787830042.054881:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830042.054904:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004da18a5b/0xc03b4d103c0d8b57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.054922:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004da18a5b/0xc03b4d103c0d8b57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.054935:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004da18a5b/0xc03b4d103c0d8b57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.054945:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004da18a5b/0xc03b4d103c0d8b57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.054959:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787830042.055831:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787830042.055843:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009863dc01/0xc03b4d103c0d8b5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.055856:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787830042.055866:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830042.055872:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009863dc01/0xc03b4d103c0d8b5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.055884:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009863dc01/0xc03b4d103c0d8b5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.056177:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009863dc01/0xc03b4d103c0d8b5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.056187:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009863dc01/0xc03b4d103c0d8b5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.056199:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1787830042.056811:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787830042.056819:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8b65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.056832:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787830042.056836:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830042.056842:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8b65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.056854:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8b65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.056863:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8b65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.056877:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8b65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.056885:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1787830042.057764:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787830042.057773:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1299e02/0xc03b4d103c0d8b6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.057781:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787830042.057787:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787830042.057791:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830042.057791:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000324f7c36/0xc03b4d103c0d8b50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.057796:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1299e02/0xc03b4d103c0d8b6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.057801:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f200 already unused, calling callback (ffffffffc1651420) 00010000:00010000:2.0:1787830042.057807:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1299e02/0xc03b4d103c0d8b6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.057807:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000324f7c36/0xc03b4d103c0d8b50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.057818:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1299e02/0xc03b4d103c0d8b6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.057819:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000324f7c36/0xc03b4d103c0d8b50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.057827:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1299e02/0xc03b4d103c0d8b6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.057836:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1787830042.057842:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000324f7c36/0xc03b4d103c0d8b50 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.057849:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000324f7c36/0xc03b4d103c0d8b50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.057869:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787830042.057873:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004da18a5b/0xc03b4d103c0d8b57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.057880:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3fa00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787830042.057889:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004da18a5b/0xc03b4d103c0d8b57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.057898:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004da18a5b/0xc03b4d103c0d8b57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.057910:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004da18a5b/0xc03b4d103c0d8b57 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.057917:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004da18a5b/0xc03b4d103c0d8b57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.057931:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787830042.057935:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009863dc01/0xc03b4d103c0d8b5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.057942:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3e600 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787830042.057945:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009863dc01/0xc03b4d103c0d8b5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.057952:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009863dc01/0xc03b4d103c0d8b5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.057962:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009863dc01/0xc03b4d103c0d8b5e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.057969:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009863dc01/0xc03b4d103c0d8b5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.057988:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787830042.057991:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8b65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.057999:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3ee00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787830042.058001:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8b65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.058009:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8b65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.058040:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8b65 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.058048:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c65d552/0xc03b4d103c0d8b65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.058060:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830042.058063:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1299e02/0xc03b4d103c0d8b6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.058069:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3e400 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787830042.058072:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1299e02/0xc03b4d103c0d8b6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.058092:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1299e02/0xc03b4d103c0d8b6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.058102:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1299e02/0xc03b4d103c0d8b6c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.058110:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1299e02/0xc03b4d103c0d8b6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.058123:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830042.058124:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830042.058126:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787830042.059700:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787830042.059716:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005df613b3/0xc03b4d103c0d8b73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.059745:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787830042.059749:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830042.059756:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005df613b3/0xc03b4d103c0d8b73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.059771:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005df613b3/0xc03b4d103c0d8b73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.059782:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005df613b3/0xc03b4d103c0d8b73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.059790:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005df613b3/0xc03b4d103c0d8b73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.059818:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787830042.060751:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830042.060766:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005df613b3/0xc03b4d103c0d8b73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.060778:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3fe00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787830042.060783:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005df613b3/0xc03b4d103c0d8b73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.060794:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005df613b3/0xc03b4d103c0d8b73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.060817:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005df613b3/0xc03b4d103c0d8b73 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.060839:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005df613b3/0xc03b4d103c0d8b73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.060864:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830042.060866:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830042.060868:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787830042.061876:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787830042.062477:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8b7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.062500:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787830042.062505:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830042.062513:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8b7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.062528:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8b7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.062556:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8b7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.062565:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8b7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.062584:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787830042.062599:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830042.062606:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8b7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.062614:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3f600 already unused, calling callback (ffffffffc1651420) 00010000:00010000:2.0:1787830042.062619:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8b7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.062629:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8b7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.062663:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8b7a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.062671:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af6641af/0xc03b4d103c0d8b7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.062691:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830042.062698:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830042.062700:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787830042.063849:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787830042.063860:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b8f3c8a/0xc03b4d103c0d8b81 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.063876:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787830042.063880:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830042.064097:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b8f3c8a/0xc03b4d103c0d8b81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.064115:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b8f3c8a/0xc03b4d103c0d8b81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.064125:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b8f3c8a/0xc03b4d103c0d8b81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.064133:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b8f3c8a/0xc03b4d103c0d8b81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.064156:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787830042.064526:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830042.064535:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b8f3c8a/0xc03b4d103c0d8b81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.064544:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3e200 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787830042.064549:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b8f3c8a/0xc03b4d103c0d8b81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.064560:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b8f3c8a/0xc03b4d103c0d8b81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.064581:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b8f3c8a/0xc03b4d103c0d8b81 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.064589:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b8f3c8a/0xc03b4d103c0d8b81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830042.064611:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830042.064613:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830042.064615:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787830042.069868:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787830042.069882:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8b88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.069898:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787830042.069903:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830042.069909:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8b88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.069931:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8b88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.069942:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8b88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.069950:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8b88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.069982:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787830042.072696:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787830042.072708:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034248946/0xc03b4d103c0d8b8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.072724:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787830042.072728:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830042.072736:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034248946/0xc03b4d103c0d8b8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.072750:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034248946/0xc03b4d103c0d8b8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.072760:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034248946/0xc03b4d103c0d8b8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.072781:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034248946/0xc03b4d103c0d8b8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.072793:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787830042.073324:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787830042.073331:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006532c076/0xc03b4d103c0d8b96 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.073341:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787830042.073345:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830042.073349:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006532c076/0xc03b4d103c0d8b96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.075455:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787830042.075476:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8b88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.075495:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9a437bde00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:1.0:1787830042.075502:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8b88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.075514:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8b88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.075541:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8b88 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.075550:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8b88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.075578:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830042.075584:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034248946/0xc03b4d103c0d8b8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.075593:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006532c076/0xc03b4d103c0d8b96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.075593:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9a437bd200 already unused, calling callback (ffffffffc1651420) 00010000:00010000:1.0:1787830042.075600:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034248946/0xc03b4d103c0d8b8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.075667:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034248946/0xc03b4d103c0d8b8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.075680:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034248946/0xc03b4d103c0d8b8f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.075687:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034248946/0xc03b4d103c0d8b8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.075702:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830042.075706:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006532c076/0xc03b4d103c0d8b96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.075707:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830042.075710:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830042.075721:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006532c076/0xc03b4d103c0d8b96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.075767:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787830042.075794:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830042.075800:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006532c076/0xc03b4d103c0d8b96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.075821:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9a437bc600 already unused, calling callback (ffffffffc1651420) 00010000:00010000:2.0:1787830042.075825:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006532c076/0xc03b4d103c0d8b96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.075835:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006532c076/0xc03b4d103c0d8b96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.075851:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006532c076/0xc03b4d103c0d8b96 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.075859:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006532c076/0xc03b4d103c0d8b96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.075885:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830042.075887:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830042.075888:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830042.076807:0:15985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830042.076823:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035f87f2e/0xc03b4d103c0d8b49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.076840:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3ec00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:1.0:1787830042.076844:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035f87f2e/0xc03b4d103c0d8b49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.076854:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035f87f2e/0xc03b4d103c0d8b49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.076877:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035f87f2e/0xc03b4d103c0d8b49 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.076901:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035f87f2e/0xc03b4d103c0d8b49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.076929:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830042.076931:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830042.076933:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830042.076938:0:15985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830042.076940:0:15985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787830042.079774:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787830042.079787:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000117b8693/0xc03b4d103c0d8b9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.079804:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787830042.079809:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830042.079815:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000117b8693/0xc03b4d103c0d8b9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.079828:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000117b8693/0xc03b4d103c0d8b9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.079847:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000117b8693/0xc03b4d103c0d8b9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.079854:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000117b8693/0xc03b4d103c0d8b9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.079884:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830042.080499:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830042.080514:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000117b8693/0xc03b4d103c0d8b9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.080529:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9a437bca00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:1.0:1787830042.080536:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000117b8693/0xc03b4d103c0d8b9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.080547:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000117b8693/0xc03b4d103c0d8b9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.080570:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000117b8693/0xc03b4d103c0d8b9d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.080578:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000117b8693/0xc03b4d103c0d8b9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.080604:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830042.080620:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830042.080622:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787830042.084058:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787830042.084074:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcd7d9fb/0xc03b4d103c0d8ba4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.084092:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787830042.084097:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830042.084104:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcd7d9fb/0xc03b4d103c0d8ba4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.084117:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcd7d9fb/0xc03b4d103c0d8ba4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.084128:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcd7d9fb/0xc03b4d103c0d8ba4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.084135:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcd7d9fb/0xc03b4d103c0d8ba4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.084173:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787830042.085230:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787830042.085240:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ae57097/0xc03b4d103c0d8bab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.085253:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787830042.085256:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830042.085262:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ae57097/0xc03b4d103c0d8bab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.085273:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ae57097/0xc03b4d103c0d8bab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.085283:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ae57097/0xc03b4d103c0d8bab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.085290:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ae57097/0xc03b4d103c0d8bab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.085316:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787830042.089866:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787830042.089886:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcd7d9fb/0xc03b4d103c0d8ba4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.089905:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9a437bcc00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:1.0:1787830042.089911:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcd7d9fb/0xc03b4d103c0d8ba4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.089925:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcd7d9fb/0xc03b4d103c0d8ba4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.089955:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcd7d9fb/0xc03b4d103c0d8ba4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.089964:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcd7d9fb/0xc03b4d103c0d8ba4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.089997:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830042.090002:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ae57097/0xc03b4d103c0d8bab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.090008:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9a437bd400 already unused, calling callback (ffffffffc1651420) 00010000:00010000:1.0:1787830042.090011:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ae57097/0xc03b4d103c0d8bab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.090059:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ae57097/0xc03b4d103c0d8bab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.090069:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ae57097/0xc03b4d103c0d8bab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.090076:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ae57097/0xc03b4d103c0d8bab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830042.090090:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830042.090092:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830042.090094:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787830042.091297:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787830042.091308:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000054833e4/0xc03b4d103c0d8bb2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.091326:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787830042.091337:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830042.091345:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000054833e4/0xc03b4d103c0d8bb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.091379:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000054833e4/0xc03b4d103c0d8bb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.091389:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000054833e4/0xc03b4d103c0d8bb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.091396:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000054833e4/0xc03b4d103c0d8bb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.091423:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787830042.091849:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787830042.091856:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b1c9d17/0xc03b4d103c0d8bb9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.091865:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787830042.091868:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830042.091872:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b1c9d17/0xc03b4d103c0d8bb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.091880:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b1c9d17/0xc03b4d103c0d8bb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.091886:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b1c9d17/0xc03b4d103c0d8bb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.091901:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b1c9d17/0xc03b4d103c0d8bb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.091933:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787830042.092388:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787830042.092395:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000907990be/0xc03b4d103c0d8bc0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.092405:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787830042.092408:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830042.092413:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000907990be/0xc03b4d103c0d8bc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.092423:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000907990be/0xc03b4d103c0d8bc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.092431:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000907990be/0xc03b4d103c0d8bc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.092438:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000907990be/0xc03b4d103c0d8bc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.092447:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:2.0:1787830042.092620:0:15013:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1787830042.092745:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14353:x1874675284151424:12345-0@lo:5:osp-pre-1-0.0 Request processed in 129639us (132657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830042.092764:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1787830042.092815:0:15985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787830042.092823:0:15985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000054833e4/0xc03b4d103c0d8bb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.092831:0:15985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9a437bc800 already unused, calling callback (ffffffffc1651420) 00010000:00010000:2.0:1787830042.092836:0:15985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000054833e4/0xc03b4d103c0d8bb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.092846:0:15985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000054833e4/0xc03b4d103c0d8bb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.092864:0:15985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000054833e4/0xc03b4d103c0d8bb2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.092872:0:15985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000054833e4/0xc03b4d103c0d8bb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.092892:0:15985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787830042.092896:0:15985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b1c9d17/0xc03b4d103c0d8bb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.092902:0:15985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9a437bdc00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:2.0:1787830042.092905:0:15985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b1c9d17/0xc03b4d103c0d8bb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.092923:0:15985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b1c9d17/0xc03b4d103c0d8bb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.092934:0:15985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b1c9d17/0xc03b4d103c0d8bb9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.092941:0:15985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b1c9d17/0xc03b4d103c0d8bb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.092953:0:15985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830042.092956:0:15985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000907990be/0xc03b4d103c0d8bc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.092963:0:15985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9a437bd000 already unused, calling callback (ffffffffc1651420) 00010000:00010000:2.0:1787830042.092966:0:15985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000907990be/0xc03b4d103c0d8bc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.092974:0:15985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000907990be/0xc03b4d103c0d8bc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.092984:0:15985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000907990be/0xc03b4d103c0d8bc0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.092990:0:15985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000907990be/0xc03b4d103c0d8bc0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830042.093013:0:15985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830042.093076:0:15985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830042.093078:0:15985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830042.093116:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fe79680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14353:1874675284151424:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787830042.093133:0:14353:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1787830042.093180:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3cfc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14353:1874675284151552:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787830042.093216:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830042.093264:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47ae0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787830042.093297:0:15414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284151552 00000100:00100000:2.0:1787830042.093303:0:15414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284151552 00000100:00100000:2.0:1787830042.093347:0:15414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787830042.093357:0:15414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14353:x1874675284151552:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787830042.093398:0:15414:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:1.0:1787830042.095783:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830042.095799:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830042.106595:0:15414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14353:x1874675284151552:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13234us (13374us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787830042.106610:0:15414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787830042.106677:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3cfc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14353:1874675284151552:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787830042.106694:0:14353:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:0.0:1787830042.115108:0:5827:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1787830042.402267:0:15985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787830042.584156:0:7602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1787830042.584359:0:7602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1787830043.432219:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787830044.327808:0:16091:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg151-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787830044.450523:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830045.475760:0:15985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830045.539631:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fe7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284151680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787830045.539727:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830045.540094:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284151680 00000100:00100000:2.0:1787830045.540103:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284151680 00000100:00100000:2.0:1787830045.540169:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787830045.540185:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284151680:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787830045.540265:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787830045.540421:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787830045.540505:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284151680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 323us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830045.540514:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787830045.540738:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fe7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284151680:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787830046.116062:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787830046.500340:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830047.074599:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787830047.074632:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f312d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284151808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787830047.074747:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830047.074926:0:15018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284151808 00000100:00100000:1.0:1787830047.074937:0:15018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284151808 00000100:00100000:1.0:1787830047.075011:0:15018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787830047.075046:0:15018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f313480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284151808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787830047.075242:0:15018:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787830047.075429:0:15018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f313480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284151808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 386us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830047.075438:0:15018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787830047.075466:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787830047.075503:0:3281:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787830047.075533:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f312d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284151808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787830047.075825:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284152320:0@lo:400:kworker.0 00000100:00100000:3.0:1787830047.075871:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830047.075908:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787830047.075914:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3280:1874675284151936:0@lo:400:kworker.0 00000100:00100000:3.0:1787830047.075947:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830047.075974:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1874675284152448:0@lo:400:kworker.0 00000100:00100000:3.0:1787830047.075998:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830047.076284:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284152064:0@lo:400:kworker.0 00000100:00100000:1.0:1787830047.076322:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830047.076354:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787830047.076361:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284152192:0@lo:400:kworker.0 00000100:00100000:1.0:1787830047.076388:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830047.076425:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284151936 00000100:00100000:1.0:1787830047.076430:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284151936 00000100:00100000:1.0:1787830047.076473:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787830047.076481:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:3280:x1874675284151936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830047.076530:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:3280:x1874675284151936:12345-0@lo:400:kworker.0 Request processed in 50us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830047.076537:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787830047.076580:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284152320 00000100:00100000:1.0:1787830047.076584:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284152320 00000100:00100000:1.0:1787830047.076614:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284152448 00000100:00100000:1.0:1787830047.076618:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284152448 00000100:00100000:1.0:1787830047.076633:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284152192 00000100:00100000:1.0:1787830047.076636:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284152192 00000100:00100000:1.0:1787830047.076650:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787830047.076656:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284152320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830047.076706:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284152320:12345-0@lo:400:kworker.0 Request processed in 50us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830047.076714:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787830047.076727:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787830047.076733:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874675284152448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830047.076761:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874675284152448:12345-0@lo:400:kworker.0 Request processed in 28us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830047.076767:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787830047.076780:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787830047.076786:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284152192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830047.076819:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284152192:12345-0@lo:400:kworker.0 Request processed in 33us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830047.076825:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1787830047.076846:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787830047.076873:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f3ce580 x1874675284152192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830047.076888:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284152192:0@lo:400:kworker.0 00000100:00100000:1.0:1787830047.076916:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3280:1874675284151936:0@lo:400:kworker.0 00010000:00080000:1.0:1787830047.076935:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f3ce1c0 x1874675284152448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830047.076945:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1874675284152448:0@lo:400:kworker.0 00010000:00080000:1.0:1787830047.076957:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b7f3ccf00 x1874675284152320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830047.076977:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284152320:0@lo:400:kworker.0 00000100:00100000:3.0:1787830047.081225:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284152064 00000100:00100000:3.0:1787830047.081264:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284152064 00000100:00100000:3.0:1787830047.081433:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787830047.081449:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284152064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830047.081594:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284152064:12345-0@lo:400:kworker.0 Request processed in 150us (5270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830047.081603:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787830047.081861:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00080000:1.0:1787830047.082596:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787830047.082661:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284152064:0@lo:400:kworker.0 00000100:00100000:2.0:1787830047.084719:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275768448 00000100:00100000:2.0:1787830047.084739:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275768448 00000100:00100000:2.0:1787830047.084815:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 77 00000100:00100000:2.0:1787830047.084826:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b75cd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2359:x1874675275768448:12345-192.168.201.51@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787830047.084868:0:14323:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 4c47ee9c-623b-47d7-a235-c0ef434319ba@192.168.201.51@tcp t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:2.0:1787830047.084911:0:14323:0:(genops.c:1385:class_connect()) connect: client 4c47ee9c-623b-47d7-a235-c0ef434319ba, cookie 0xc03b4d103c0d8bc7 00000100:00080000:2.0:1787830047.085201:0:14323:0:(import.c:65:import_set_state_nolock()) ffff9e9b4fb1d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787830047.086209:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b75cd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c47ee9c-623b-47d7-a235-c0ef434319ba+5:2359:x1874675275768448:12345-192.168.201.51@tcp:250:mount.lustre.0 Request processed in 1377us (4345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830047.086223:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 77 00000100:00100000:3.0:1787830047.093537:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830047.099306:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275768576 00000100:00100000:0.0:1787830047.099329:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275768576 00000100:00100000:1.0:1787830047.099749:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 78 00000100:00100000:1.0:1787830047.099764:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7b5cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c47ee9c-623b-47d7-a235-c0ef434319ba+5:13771:x1874675275768576:12345-192.168.201.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787830047.099789:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830047.099815:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b7feee200/0xc03b4d103c0d8bce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x53172783628c8b36 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830047.099856:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b7feee200/0xc03b4d103c0d8bce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b36 expref: 6 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830047.099869:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b7feee200/0xc03b4d103c0d8bce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b36 expref: 6 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830047.099880:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feee200, rc 0) 00000100:00100000:1.0:1787830047.099974:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7b5cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c47ee9c-623b-47d7-a235-c0ef434319ba+6:13771:x1874675275768576:12345-192.168.201.51@tcp:101:mount.lustre.0 Request processed in 213us (6454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830047.099983:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 78 00000100:00100000:0.0:1787830047.104686:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830047.104821:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275768704 00000100:00100000:2.0:1787830047.104835:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275768704 00000100:00100000:2.0:1787830047.104914:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 79 00000100:00100000:2.0:1787830047.104925:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7b5c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c47ee9c-623b-47d7-a235-c0ef434319ba+6:13771:x1874675275768704:12345-192.168.201.51@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787830047.105365:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7b5c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c47ee9c-623b-47d7-a235-c0ef434319ba+6:13771:x1874675275768704:12345-192.168.201.51@tcp:501:mount.lustre.0 Request processed in 439us (692us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787830047.105376:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 79 00000100:00100000:0.0:1787830047.117230:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830047.117794:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275768832 00000100:00100000:2.0:1787830047.117810:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275768832 00000100:00100000:2.0:1787830047.117900:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 80 00000100:00100000:2.0:1787830047.117983:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7b5c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c47ee9c-623b-47d7-a235-c0ef434319ba+6:13771:x1874675275768832:12345-192.168.201.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787830047.118011:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830047.118331:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b40031400/0xc03b4d103c0d8bd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x53172783628c8b3d expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830047.118376:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b40031400/0xc03b4d103c0d8bd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b3d expref: 7 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830047.118396:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b40031400/0xc03b4d103c0d8bd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b3d expref: 7 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830047.118407:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b40031400, rc 0) 00000100:00100000:3.0:1787830047.118499:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7b5c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c47ee9c-623b-47d7-a235-c0ef434319ba+7:13771:x1874675275768832:12345-192.168.201.51@tcp:101:mount.lustre.0 Request processed in 588us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830047.118508:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 80 00000100:00100000:3.0:1787830047.120474:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830047.120621:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275768960 00000100:00100000:1.0:1787830047.120633:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275768960 00000100:00100000:1.0:1787830047.120700:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 81 00000100:00100000:1.0:1787830047.120710:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7b5c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c47ee9c-623b-47d7-a235-c0ef434319ba+7:13771:x1874675275768960:12345-192.168.201.51@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787830047.121186:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7b5c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c47ee9c-623b-47d7-a235-c0ef434319ba+8:13771:x1874675275768960:12345-192.168.201.51@tcp:501:mount.lustre.0 Request processed in 474us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830047.121206:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 81 00000100:00100000:3.0:1787830047.123287:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830047.123386:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275769088 00000100:00100000:1.0:1787830047.123397:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275769088 00000100:00100000:1.0:1787830047.123458:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 82 00000100:00100000:1.0:1787830047.123469:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7b5ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c47ee9c-623b-47d7-a235-c0ef434319ba+8:13771:x1874675275769088:12345-192.168.201.51@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787830047.125595:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7b5ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c47ee9c-623b-47d7-a235-c0ef434319ba+8:13771:x1874675275769088:12345-192.168.201.51@tcp:503:mount.lustre.0 Request processed in 2104us (2297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830047.125620:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 82 00000100:00100000:3.0:1787830047.132623:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830047.132764:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275769216 00000100:00100000:0.0:1787830047.132782:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275769216 00000100:00100000:0.0:1787830047.132931:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 83 00000100:00100000:0.0:1787830047.132944:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7b5c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c47ee9c-623b-47d7-a235-c0ef434319ba+8:13790:x1874675275769216:12345-192.168.201.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787830047.133705:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7b5c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c47ee9c-623b-47d7-a235-c0ef434319ba+8:13790:x1874675275769216:12345-192.168.201.51@tcp:502:llog_process_th.0 Request processed in 758us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830047.133719:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 83 00000100:00100000:0.0:1787830047.152619:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830047.152741:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275769344 00000100:00100000:2.0:1787830047.152755:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275769344 00000100:00100000:2.0:1787830047.152833:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 84 00000100:00100000:2.0:1787830047.152845:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7b5c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c47ee9c-623b-47d7-a235-c0ef434319ba+8:13790:x1874675275769344:12345-192.168.201.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787830047.153334:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7b5c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c47ee9c-623b-47d7-a235-c0ef434319ba+8:13790:x1874675275769344:12345-192.168.201.51@tcp:502:llog_process_th.0 Request processed in 488us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830047.153344:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 84 00000100:00100000:2.0:1787830047.159471:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830047.159644:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275769472 00000100:00100000:1.0:1787830047.159658:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275769472 00000100:00100000:1.0:1787830047.159737:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 85 00000100:00100000:1.0:1787830047.159749:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7b5c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c47ee9c-623b-47d7-a235-c0ef434319ba+8:13771:x1874675275769472:12345-192.168.201.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787830047.159776:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830047.159804:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b7feef000/0xc03b4d103c0d8bdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x53172783628c8b67 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830047.159846:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b7feef000/0xc03b4d103c0d8bdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b67 expref: 9 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830047.159859:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b7feef000/0xc03b4d103c0d8bdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b67 expref: 9 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830047.159891:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feef000, rc 0) 00000100:00100000:1.0:1787830047.160770:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7b5c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c47ee9c-623b-47d7-a235-c0ef434319ba+9:13771:x1874675275769472:12345-192.168.201.51@tcp:101:mount.lustre.0 Request processed in 1017us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830047.160781:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 85 00000100:00100000:2.0:1787830047.168584:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830047.168711:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275769600 00000100:00100000:0.0:1787830047.168724:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275769600 00000100:00100000:0.0:1787830047.168904:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 86 00000100:00100000:0.0:1787830047.168917:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7b5cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c47ee9c-623b-47d7-a235-c0ef434319ba+9:13771:x1874675275769600:12345-192.168.201.51@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787830047.168961:0:14322:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787830047.168994:0:14322:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787830047.168998:0:14322:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787830047.169002:0:14322:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787830047.169004:0:14322:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787830047.172724:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7b5cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c47ee9c-623b-47d7-a235-c0ef434319ba+9:13771:x1874675275769600:12345-192.168.201.51@tcp:256:mount.lustre.0 Request processed in 3792us (4138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830047.172744:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 86 00000100:00100000:3.0:1787830047.176288:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830047.176371:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275769728 00000100:00100000:1.0:1787830047.176390:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275769728 00000100:00100000:1.0:1787830047.176489:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 87 00000100:00100000:1.0:1787830047.176499:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7b5c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c47ee9c-623b-47d7-a235-c0ef434319ba+9:13771:x1874675275769728:12345-192.168.201.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787830047.176521:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830047.176540:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b7feee600/0xc03b4d103c0d8be3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x53172783628c8b6e expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830047.176590:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b7feee600/0xc03b4d103c0d8be3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b6e expref: 10 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830047.176603:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b7feee600/0xc03b4d103c0d8be3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b6e expref: 10 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830047.176615:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feee600, rc 0) 00000100:00100000:1.0:1787830047.176689:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7b5c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c47ee9c-623b-47d7-a235-c0ef434319ba+10:13771:x1874675275769728:12345-192.168.201.51@tcp:101:mount.lustre.0 Request processed in 193us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830047.176695:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 87 00000100:00100000:3.0:1787830047.178479:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830047.178539:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275769856 00000100:00100000:2.0:1787830047.178565:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275769856 00000100:00100000:2.0:1787830047.178631:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 88 00000100:00100000:2.0:1787830047.178642:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7b5cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c47ee9c-623b-47d7-a235-c0ef434319ba+10:13771:x1874675275769856:12345-192.168.201.51@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787830047.179178:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7b5cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c47ee9c-623b-47d7-a235-c0ef434319ba+10:13771:x1874675275769856:12345-192.168.201.51@tcp:501:mount.lustre.0 Request processed in 537us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830047.179189:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 88 00000100:00100000:0.0:1787830047.181227:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830047.181392:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275769984 00000100:00100000:1.0:1787830047.181404:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275769984 00000100:00100000:1.0:1787830047.181474:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 89 00000100:00100000:1.0:1787830047.181485:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7b5ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c47ee9c-623b-47d7-a235-c0ef434319ba+10:13771:x1874675275769984:12345-192.168.201.51@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787830047.182458:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7b5ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c47ee9c-623b-47d7-a235-c0ef434319ba+10:13771:x1874675275769984:12345-192.168.201.51@tcp:503:mount.lustre.0 Request processed in 967us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830047.182471:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 89 00000100:00100000:3.0:1787830047.186157:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830047.186234:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275770112 00000100:00100000:2.0:1787830047.186311:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275770112 00000100:00100000:2.0:1787830047.186444:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 90 00000100:00100000:2.0:1787830047.186456:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7b5ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c47ee9c-623b-47d7-a235-c0ef434319ba+10:13796:x1874675275770112:12345-192.168.201.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787830047.187134:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7b5ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c47ee9c-623b-47d7-a235-c0ef434319ba+10:13796:x1874675275770112:12345-192.168.201.51@tcp:502:llog_process_th.0 Request processed in 676us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830047.187146:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 90 00000100:00100000:3.0:1787830047.196598:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830047.196764:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275770240 00000100:00100000:1.0:1787830047.196777:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275770240 00000100:00100000:1.0:1787830047.197485:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 91 00000100:00100000:1.0:1787830047.197508:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c47ee9c-623b-47d7-a235-c0ef434319ba+10:13796:x1874675275770240:12345-192.168.201.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787830047.197989:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c47ee9c-623b-47d7-a235-c0ef434319ba+10:13796:x1874675275770240:12345-192.168.201.51@tcp:502:llog_process_th.0 Request processed in 489us (1408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830047.204073:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830047.204138:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275770368 00000100:00100000:2.0:1787830047.204174:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275770368 00000100:00100000:1.0:1787830047.206364:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 91 00000100:00100000:2.0:1787830047.206455:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 4 00000100:00100000:2.0:1787830047.206495:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2359:x1874675275770368:12345-192.168.201.51@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787830047.206557:0:14329:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from bad48885-a767-440f-85b6-3e1bee305ba5@192.168.201.51@tcp t0 exp 0000000000000000 cur 427 last 0 00000020:00000080:2.0:1787830047.206630:0:14329:0:(genops.c:1385:class_connect()) connect: client bad48885-a767-440f-85b6-3e1bee305ba5, cookie 0xc03b4d103c0d8bea 00000004:00100000:2.0:1787830047.206679:0:14329:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000001:00000004:2.0:1787830047.206686:0:14329:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1787830047.245571:0:14329:0:(import.c:65:import_set_state_nolock()) ffff9e9a41373000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787830047.245677:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+6:2359:x1874675275770368:12345-192.168.201.51@tcp:38:mount.lustre.0 Request processed in 39183us (41619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830047.245690:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 4 00000100:00100000:3.0:1787830047.248884:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830047.248979:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275770496 00000100:00100000:0.0:1787830047.248993:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275770496 00000100:00080000:1.0:1787830047.249602:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787830047.249810:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 5 00000100:00100000:0.0:1787830047.249833:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+6:0:x1874675275770496:12345-192.168.201.51@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787830047.249924:0:14328:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787830047.250116:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+6:0:x1874675275770496:12345-192.168.201.51@tcp:41:mount.lustre.0 Request processed in 292us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830047.250570:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830047.250901:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 5 00000100:00100000:2.0:1787830047.250946:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275770624 00000100:00100000:2.0:1787830047.250955:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275770624 00000100:00100000:2.0:1787830047.251046:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 6 00000100:00100000:2.0:1787830047.251057:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+7:13771:x1874675275770624:12345-192.168.201.51@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787830047.251083:0:14329:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787830047.251461:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+6:13771:x1874675275770624:12345-192.168.201.51@tcp:41:mount.lustre.0 Request processed in 405us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830047.251469:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 6 00000100:00100000:1.0:1787830047.254106:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830047.254270:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275770752 00000100:00100000:2.0:1787830047.254284:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275770752 00000100:00100000:2.0:1787830047.254357:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 7 00000100:00100000:2.0:1787830047.254368:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bad48885-a767-440f-85b6-3e1bee305ba5+6:13771:x1874675275770752:12345-192.168.201.51@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787830047.254489:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bad48885-a767-440f-85b6-3e1bee305ba5+6:13771:x1874675275770752:12345-192.168.201.51@tcp:40:mount.lustre.0 Request processed in 123us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830047.254498:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 7 00000100:00100000:3.0:1787830047.256858:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830047.259908:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275770880 00000100:00100000:0.0:1787830047.259931:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275770880 00000100:00100000:0.0:1787830047.260286:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 9 00000100:00100000:0.0:1787830047.260297:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2359:x1874675275770880:12345-192.168.201.51@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787830047.260342:0:15016:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from bad48885-a767-440f-85b6-3e1bee305ba5@192.168.201.51@tcp t0 exp 0000000000000000 cur 427 last 0 00000020:00000080:1.0:1787830047.260468:0:15016:0:(genops.c:1385:class_connect()) connect: client bad48885-a767-440f-85b6-3e1bee305ba5, cookie 0xc03b4d103c0d8bf1 00002000:00100000:1.0:1787830047.260487:0:15016:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bad48885-a767-440f-85b6-3e1bee305ba5/ffff9e9a41370000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787830047.260518:0:15016:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1787830047.261201:0:15016:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787830047.261324:0:15016:0:(import.c:65:import_set_state_nolock()) ffff9e9a41371800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787830047.261504:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bad48885-a767-440f-85b6-3e1bee305ba5+6:2359:x1874675275770880:12345-192.168.201.51@tcp:8:mount.lustre.0 Request processed in 1205us (4656us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830047.261522:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 9 00000100:00100000:1.0:1787830047.262877:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830047.263667:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275771008 00000100:00100000:3.0:1787830047.263681:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275771008 00000100:00100000:2.0:1787830047.263718:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830047.263736:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 10 00000100:00100000:3.0:1787830047.263746:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f9983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2359:x1874675275771008:12345-192.168.201.51@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787830047.263788:0:15015:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from bad48885-a767-440f-85b6-3e1bee305ba5@192.168.201.51@tcp t0 exp 0000000000000000 cur 427 last 0 00000020:00000080:3.0:1787830047.263830:0:15015:0:(genops.c:1385:class_connect()) connect: client bad48885-a767-440f-85b6-3e1bee305ba5, cookie 0xc03b4d103c0d8bf8 00002000:00100000:3.0:1787830047.263847:0:15015:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bad48885-a767-440f-85b6-3e1bee305ba5/ffff9e9b50d54000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787830047.263862:0:15015:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00000100:00100000:1.0:1787830047.264301:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275771136 00000100:00100000:1.0:1787830047.264306:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275771136 00000100:00100000:1.0:1787830047.264344:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 0 00000100:00100000:1.0:1787830047.264350:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bad48885-a767-440f-85b6-3e1bee305ba5+6:13771:x1874675275771136:12345-192.168.201.51@tcp:33:mount.lustre.0 00002000:00080000:3.0:1787830047.266623:0:15015:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787830047.266688:0:15015:0:(import.c:65:import_set_state_nolock()) ffff9e9b50d52800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787830047.267069:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f9983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bad48885-a767-440f-85b6-3e1bee305ba5+6:2359:x1874675275771008:12345-192.168.201.51@tcp:8:mount.lustre.0 Request processed in 3069us (3946us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830047.267082:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 10 00000004:00080000:0.0:1787830047.268324:0:14331:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3847us 00000004:00200000:1.0:1787830047.284827:0:14331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787830047.285182:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bad48885-a767-440f-85b6-3e1bee305ba5+6:13771:x1874675275771136:12345-192.168.201.51@tcp:33:mount.lustre.0 Request processed in 20821us (21457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830047.285197:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 0 00000100:00100000:2.0:1787830047.494893:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830047.495611:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275771264 00000100:00100000:1.0:1787830047.495625:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275771264 00000100:00100000:1.0:1787830047.495749:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 8 00000100:00100000:1.0:1787830047.495761:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+6:13817:x1874675275771264:12345-192.168.201.51@tcp:101:mkdir.0 00010000:00010000:1.0:1787830047.495792:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830047.495825:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d8bff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8b98 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830047.495917:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d8c06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830047.495946:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d8c06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830047.495974:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d8c06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787830047.496315:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787830047.496321:0:14329:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787830047.496447:0:14329:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d8c06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830047.496497:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee800/0xc03b4d103c0d8bff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b98 expref: 8 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830047.496520:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d8c06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b98 expref: 7 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830047.496529:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b507a7600) 00010000:00010000:1.0:1787830047.496532:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787830047.496548:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feef200, rc 0) 00000100:00100000:1.0:1787830047.496841:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+7:13817:x1874675275771264:12345-192.168.201.51@tcp:101:mkdir.0 Request processed in 1081us (1962us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830047.496851:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 8 00010000:00010000:1.0:1787830047.523914:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787830047.694805:0:7602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bad48885-a767-440f-85b6-3e1bee305ba5 00000001:00100000:0.0:1787830047.700708:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bad48885-a767-440f-85b6-3e1bee305ba5 00010000:00010000:1.0:1787830048.546280:0:15985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830049.570340:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830049.842118:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830049.842372:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275771392 00000100:00100000:0.0:1787830049.842387:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275771392 00000100:00080000:1.0:1787830049.842713:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787830049.842839:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 9 00000100:00100000:0.0:1787830049.842856:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+7:13869:x1874675275771392:12345-192.168.201.51@tcp:41:lfs.0 00000004:00000024:0.0:1787830049.842919:0:14328:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787830049.843085:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+7:13869:x1874675275771392:12345-192.168.201.51@tcp:41:lfs.0 Request processed in 234us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830049.843094:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 9 00000100:00100000:0.0:1787830049.847295:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830049.848910:0:15018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275771520 00000100:00100000:1.0:1787830049.848929:0:15018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275771520 00000100:00100000:1.0:1787830049.849218:0:15018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 6 00000100:00100000:1.0:1787830049.849231:0:15018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f312d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bad48885-a767-440f-85b6-3e1bee305ba5+5:13869:x1874675275771520:12345-192.168.201.51@tcp:13:lfs.0 00002000:00000024:1.0:1787830049.849285:0:15018:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787830049.849418:0:15018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f312d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bad48885-a767-440f-85b6-3e1bee305ba5+5:13869:x1874675275771520:12345-192.168.201.51@tcp:13:lfs.0 Request processed in 189us (2138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830049.849427:0:15018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 6 00000100:00080000:2.0:1787830049.852152:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787830049.854246:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830049.854470:0:15018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275771648 00000100:00100000:1.0:1787830049.854598:0:15018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275771648 00000100:00100000:1.0:1787830049.854695:0:15018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 7 00000100:00100000:1.0:1787830049.854709:0:15018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe79e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bad48885-a767-440f-85b6-3e1bee305ba5+5:13869:x1874675275771648:12345-192.168.201.51@tcp:13:lfs.0 00002000:00000024:1.0:1787830049.854782:0:15018:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787830049.854983:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787830049.855803:0:15018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe79e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bad48885-a767-440f-85b6-3e1bee305ba5+5:13869:x1874675275771648:12345-192.168.201.51@tcp:13:lfs.0 Request processed in 1090us (1564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830049.855816:0:15018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 7 00000100:00100000:0.0:1787830050.103580:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830050.103880:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275771776 00000100:00100000:2.0:1787830050.103911:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275771776 00000100:00100000:2.0:1787830050.103997:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 92 00000100:00100000:2.0:1787830050.104010:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c47ee9c-623b-47d7-a235-c0ef434319ba+10:13900:x1874675275771776:12345-192.168.201.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787830050.104076:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830050.104102:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9a437bc400/0xc03b4d103c0d8c0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x53172783628c8b9f expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830050.104142:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9a437bc400/0xc03b4d103c0d8c0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b9f expref: 11 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830050.104157:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9a437bc400/0xc03b4d103c0d8c0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b9f expref: 11 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830050.104169:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9a437bc400, rc 0) 00000100:00100000:2.0:1787830050.104265:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c47ee9c-623b-47d7-a235-c0ef434319ba+11:13900:x1874675275771776:12345-192.168.201.51@tcp:101:mount.lustre.0 Request processed in 257us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830050.104273:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 92 00000100:00100000:0.0:1787830050.117361:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830050.119112:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275771904 00000100:00100000:1.0:1787830050.119128:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275771904 00000100:00100000:1.0:1787830050.119220:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 93 00000100:00100000:1.0:1787830050.119232:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c47ee9c-623b-47d7-a235-c0ef434319ba+11:13900:x1874675275771904:12345-192.168.201.51@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787830050.119765:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c47ee9c-623b-47d7-a235-c0ef434319ba+11:13900:x1874675275771904:12345-192.168.201.51@tcp:501:mount.lustre.0 Request processed in 532us (2418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830050.119776:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 93 00000100:00100000:2.0:1787830050.135640:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830050.136985:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275772032 00000100:00100000:1.0:1787830050.137003:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275772032 00000100:00100000:1.0:1787830050.137142:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 94 00000100:00100000:1.0:1787830050.137155:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c47ee9c-623b-47d7-a235-c0ef434319ba+11:13900:x1874675275772032:12345-192.168.201.51@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787830050.138140:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c47ee9c-623b-47d7-a235-c0ef434319ba+11:13900:x1874675275772032:12345-192.168.201.51@tcp:503:mount.lustre.0 Request processed in 980us (2510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830050.138153:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 94 00000100:00100000:0.0:1787830050.152681:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830050.152790:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275772160 00000100:00100000:3.0:1787830050.152804:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275772160 00000100:00100000:3.0:1787830050.152876:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 95 00000100:00100000:3.0:1787830050.152888:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c47ee9c-623b-47d7-a235-c0ef434319ba+11:13907:x1874675275772160:12345-192.168.201.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787830050.153401:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c47ee9c-623b-47d7-a235-c0ef434319ba+11:13907:x1874675275772160:12345-192.168.201.51@tcp:502:llog_process_th.0 Request processed in 512us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830050.153412:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 95 00000100:00100000:0.0:1787830050.207668:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830050.211947:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275772288 00000100:00100000:1.0:1787830050.211969:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275772288 00000100:00100000:1.0:1787830050.212092:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 96 00000100:00100000:1.0:1787830050.212106:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c47ee9c-623b-47d7-a235-c0ef434319ba+11:13907:x1874675275772288:12345-192.168.201.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787830050.212854:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c47ee9c-623b-47d7-a235-c0ef434319ba+11:13907:x1874675275772288:12345-192.168.201.51@tcp:502:llog_process_th.0 Request processed in 747us (5196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830050.212865:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 96 00000100:00100000:2.0:1787830050.258932:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830050.259071:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275772416 00000100:00100000:3.0:1787830050.259091:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275772416 00000100:00100000:3.0:1787830050.259164:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 97 00000100:00100000:3.0:1787830050.259177:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c47ee9c-623b-47d7-a235-c0ef434319ba+11:13900:x1874675275772416:12345-192.168.201.51@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787830050.259200:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830050.259226:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b40030c00/0xc03b4d103c0d8c14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x53172783628c8bc9 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830050.259261:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b40030c00/0xc03b4d103c0d8c14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8bc9 expref: 12 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830050.259275:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b40030c00/0xc03b4d103c0d8c14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8bc9 expref: 12 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830050.259288:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b40030c00, rc 0) 00000100:00100000:3.0:1787830050.259361:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c47ee9c-623b-47d7-a235-c0ef434319ba+12:13900:x1874675275772416:12345-192.168.201.51@tcp:101:mount.lustre.0 Request processed in 186us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830050.259389:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 97 00000100:00100000:0.0:1787830050.265590:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830050.265740:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275772544 00000100:00100000:1.0:1787830050.265752:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275772544 00000100:00100000:1.0:1787830050.265831:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 98 00000100:00100000:1.0:1787830050.265844:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c47ee9c-623b-47d7-a235-c0ef434319ba+12:13900:x1874675275772544:12345-192.168.201.51@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787830050.265877:0:14321:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787830050.265898:0:14321:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787830050.265902:0:14321:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787830050.265905:0:14321:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787830050.265908:0:14321:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787830050.269241:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c47ee9c-623b-47d7-a235-c0ef434319ba+12:13900:x1874675275772544:12345-192.168.201.51@tcp:256:mount.lustre.0 Request processed in 3382us (3647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830050.269260:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 98 00000100:00100000:3.0:1787830050.282199:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830050.282311:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275772672 00000100:00100000:2.0:1787830050.282321:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275772672 00000100:00100000:2.0:1787830050.282379:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 99 00000100:00100000:2.0:1787830050.282387:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f4d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c47ee9c-623b-47d7-a235-c0ef434319ba+12:13900:x1874675275772672:12345-192.168.201.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787830050.282407:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830050.282426:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9a437bd600/0xc03b4d103c0d8c1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x53172783628c8bd0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830050.282460:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9a437bd600/0xc03b4d103c0d8c1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8bd0 expref: 13 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830050.282487:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9a437bd600/0xc03b4d103c0d8c1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8bd0 expref: 13 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830050.282509:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9a437bd600, rc 0) 00000100:00100000:2.0:1787830050.282592:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f4d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c47ee9c-623b-47d7-a235-c0ef434319ba+13:13900:x1874675275772672:12345-192.168.201.51@tcp:101:mount.lustre.0 Request processed in 204us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830050.282600:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 99 00000100:00100000:0.0:1787830050.287239:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830050.287627:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275772800 00000100:00100000:1.0:1787830050.287642:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275772800 00000100:00100000:1.0:1787830050.287834:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 100 00000100:00100000:1.0:1787830050.287846:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c47ee9c-623b-47d7-a235-c0ef434319ba+13:13900:x1874675275772800:12345-192.168.201.51@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787830050.288287:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c47ee9c-623b-47d7-a235-c0ef434319ba+13:13900:x1874675275772800:12345-192.168.201.51@tcp:501:mount.lustre.0 Request processed in 440us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830050.288296:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 100 00000100:00100000:0.0:1787830050.292642:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830050.292930:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275772928 00000100:00100000:3.0:1787830050.292943:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275772928 00000100:00100000:3.0:1787830050.293329:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 101 00000100:00100000:3.0:1787830050.293342:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c47ee9c-623b-47d7-a235-c0ef434319ba+13:13900:x1874675275772928:12345-192.168.201.51@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787830050.293716:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c47ee9c-623b-47d7-a235-c0ef434319ba+13:13900:x1874675275772928:12345-192.168.201.51@tcp:503:mount.lustre.0 Request processed in 376us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830050.293725:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 101 00000100:00100000:3.0:1787830050.301188:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830050.301685:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275773056 00000100:00100000:2.0:1787830050.301698:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275773056 00000100:00100000:2.0:1787830050.301851:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 102 00000100:00100000:2.0:1787830050.301863:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c47ee9c-623b-47d7-a235-c0ef434319ba+13:13911:x1874675275773056:12345-192.168.201.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787830050.302544:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c47ee9c-623b-47d7-a235-c0ef434319ba+13:13911:x1874675275773056:12345-192.168.201.51@tcp:502:llog_process_th.0 Request processed in 680us (1522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830050.302555:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 102 00000100:00100000:0.0:1787830050.311473:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830050.312094:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275773184 00000100:00100000:1.0:1787830050.312108:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275773184 00000100:00100000:1.0:1787830050.312247:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 103 00000100:00100000:1.0:1787830050.312259:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c47ee9c-623b-47d7-a235-c0ef434319ba+13:13911:x1874675275773184:12345-192.168.201.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787830050.314468:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c47ee9c-623b-47d7-a235-c0ef434319ba+13:13911:x1874675275773184:12345-192.168.201.51@tcp:502:llog_process_th.0 Request processed in 2197us (2997us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830050.314484:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 103 00000100:00100000:0.0:1787830050.320544:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830050.320591:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830050.320612:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830050.320630:0:15414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275773824 00000100:00100000:3.0:1787830050.320643:0:15414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275773824 00000100:00100000:0.0:1787830050.320650:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830050.320722:0:15414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275773952 00000100:00100000:3.0:1787830050.320726:0:15414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275773952 00000100:00100000:1.0:1787830050.320892:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275773312 00000100:00100000:1.0:1787830050.320896:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275773312 00000100:00100000:1.0:1787830050.320924:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275773696 00000100:00100000:1.0:1787830050.320926:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275773696 00000100:00100000:1.0:1787830050.320963:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 17 00000100:00100000:1.0:1787830050.320976:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+7:2360:x1874675275773696:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787830050.321281:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+7:2360:x1874675275773696:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 307us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830050.321290:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 17 00000100:00100000:1.0:1787830050.321312:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 10 00000100:00100000:1.0:1787830050.321317:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f310780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2359:x1874675275773312:12345-192.168.201.51@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787830050.321346:0:14329:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 612b807d-ada2-4e97-9e6f-ce18d749b2d4@192.168.201.51@tcp t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:1.0:1787830050.321400:0:14329:0:(genops.c:1385:class_connect()) connect: client 612b807d-ada2-4e97-9e6f-ce18d749b2d4, cookie 0xc03b4d103c0d8c22 00000004:00100000:1.0:1787830050.321450:0:14329:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:1.0:1787830050.321620:0:14329:0:(import.c:65:import_set_state_nolock()) ffff9e9b76a0b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787830050.321657:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f310780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:612b807d-ada2-4e97-9e6f-ce18d749b2d4+6:2359:x1874675275773312:12345-192.168.201.51@tcp:38:mount.lustre.0 Request processed in 338us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830050.321665:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 10 00000100:00100000:3.0:1787830050.321697:0:15414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 4 00000100:00100000:3.0:1787830050.321708:0:15414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f313840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bad48885-a767-440f-85b6-3e1bee305ba5+5:2360:x1874675275773824:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787830050.321761:0:15414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f313840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bad48885-a767-440f-85b6-3e1bee305ba5+5:2360:x1874675275773824:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 56us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830050.321768:0:15414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 4 00000100:00100000:3.0:1787830050.321780:0:15414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 5 00000100:00100000:3.0:1787830050.321786:0:15414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f310000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bad48885-a767-440f-85b6-3e1bee305ba5+5:2360:x1874675275773952:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787830050.321812:0:15414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f310000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bad48885-a767-440f-85b6-3e1bee305ba5+5:2360:x1874675275773952:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 26us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830050.321818:0:15414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 5 00000100:00100000:2.0:1787830050.342123:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830050.342232:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830050.342365:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275773440 00000100:00100000:0.0:1787830050.342379:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275773440 00000100:00100000:1.0:1787830050.342440:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275773568 00000100:00100000:1.0:1787830050.342444:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275773568 00000100:00100000:1.0:1787830050.342475:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 11 00000100:00100000:1.0:1787830050.342485:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:612b807d-ada2-4e97-9e6f-ce18d749b2d4+7:0:x1874675275773440:12345-192.168.201.51@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787830050.342556:0:14329:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1787830050.342565:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787830050.342657:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:612b807d-ada2-4e97-9e6f-ce18d749b2d4+7:0:x1874675275773440:12345-192.168.201.51@tcp:41:mount.lustre.0 Request processed in 172us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830050.350930:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 11 00000100:00100000:1.0:1787830050.351253:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 12 00000100:00100000:1.0:1787830050.351272:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:612b807d-ada2-4e97-9e6f-ce18d749b2d4+6:13900:x1874675275773568:12345-192.168.201.51@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787830050.351317:0:14329:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787830050.351574:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:612b807d-ada2-4e97-9e6f-ce18d749b2d4+6:13900:x1874675275773568:12345-192.168.201.51@tcp:41:mount.lustre.0 Request processed in 310us (9340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830050.351583:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 12 00000100:00100000:2.0:1787830050.362282:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830050.362536:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275774080 00000100:00100000:0.0:1787830050.362548:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275774080 00000100:00100000:0.0:1787830050.362623:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 13 00000100:00100000:0.0:1787830050.362633:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:612b807d-ada2-4e97-9e6f-ce18d749b2d4+6:13900:x1874675275774080:12345-192.168.201.51@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787830050.362749:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:612b807d-ada2-4e97-9e6f-ce18d749b2d4+6:13900:x1874675275774080:12345-192.168.201.51@tcp:40:mount.lustre.0 Request processed in 117us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830050.362757:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 13 00000100:00100000:0.0:1787830050.365581:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830050.367512:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830050.367561:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830050.367698:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275774208 00000100:00100000:3.0:1787830050.367712:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275774208 00000100:00100000:3.0:1787830050.367763:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275774336 00000100:00100000:3.0:1787830050.367767:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275774336 00000100:00100000:3.0:1787830050.367793:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 11 00000100:00100000:3.0:1787830050.367804:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2359:x1874675275774208:12345-192.168.201.51@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787830050.367847:0:15016:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 612b807d-ada2-4e97-9e6f-ce18d749b2d4@192.168.201.51@tcp t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:3.0:1787830050.367887:0:15016:0:(genops.c:1385:class_connect()) connect: client 612b807d-ada2-4e97-9e6f-ce18d749b2d4, cookie 0xc03b4d103c0d8c29 00002000:00100000:3.0:1787830050.367904:0:15016:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 612b807d-ada2-4e97-9e6f-ce18d749b2d4/ffff9e9b50d52000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787830050.367918:0:15016:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:3.0:1787830050.368309:0:15016:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787830050.368351:0:15016:0:(import.c:65:import_set_state_nolock()) ffff9e9b50d55800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787830050.368777:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:612b807d-ada2-4e97-9e6f-ce18d749b2d4+6:2359:x1874675275774208:12345-192.168.201.51@tcp:8:mount.lustre.0 Request processed in 971us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830050.368787:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 11 00000100:00100000:3.0:1787830050.368815:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 12 00000100:00100000:3.0:1787830050.368821:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2359:x1874675275774336:12345-192.168.201.51@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787830050.368843:0:15016:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 612b807d-ada2-4e97-9e6f-ce18d749b2d4@192.168.201.51@tcp t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:3.0:1787830050.368864:0:15016:0:(genops.c:1385:class_connect()) connect: client 612b807d-ada2-4e97-9e6f-ce18d749b2d4, cookie 0xc03b4d103c0d8c30 00002000:00100000:3.0:1787830050.368872:0:15016:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 612b807d-ada2-4e97-9e6f-ce18d749b2d4/ffff9e9b50d57000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787830050.368879:0:15016:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:3.0:1787830050.369546:0:15016:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787830050.369577:0:15016:0:(import.c:65:import_set_state_nolock()) ffff9e9b50d50800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787830050.369628:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:612b807d-ada2-4e97-9e6f-ce18d749b2d4+6:2359:x1874675275774336:12345-192.168.201.51@tcp:8:mount.lustre.0 Request processed in 805us (2065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830050.369658:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 12 00000100:00100000:1.0:1787830050.372466:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275774464 00000100:00100000:1.0:1787830050.372497:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275774464 00000100:00100000:1.0:1787830050.372583:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 1 00000100:00100000:1.0:1787830050.372595:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f310b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:612b807d-ada2-4e97-9e6f-ce18d749b2d4+6:13900:x1874675275774464:12345-192.168.201.51@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787830050.372999:0:14332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787830050.373231:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f310b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:612b807d-ada2-4e97-9e6f-ce18d749b2d4+6:13900:x1874675275774464:12345-192.168.201.51@tcp:33:mount.lustre.0 Request processed in 636us (7662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830050.373241:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 1 00010000:00010000:1.0:1787830050.597668:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830050.603661:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830050.610233:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275774592 00000100:00100000:1.0:1787830050.610258:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275774592 00000100:00100000:1.0:1787830050.610358:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 14 00000100:00100000:1.0:1787830050.610370:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:612b807d-ada2-4e97-9e6f-ce18d749b2d4+6:13932:x1874675275774592:12345-192.168.201.51@tcp:101:mkdir.0 00010000:00010000:1.0:1787830050.610399:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830050.610442:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d8c37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8bfa expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830050.610544:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d8c3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830050.610562:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d8c3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830050.610597:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d8c3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787830050.611736:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787830050.611746:0:14329:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787830050.611863:0:14329:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d8c3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830050.611924:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feeea00/0xc03b4d103c0d8c37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8bfa expref: 8 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830050.611965:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d8c3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8bfa expref: 7 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830050.611975:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b507a7600) 00010000:00010000:2.0:1787830050.611978:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787830050.611982:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feefc00, rc 0) 00000100:00100000:2.0:1787830050.612838:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:612b807d-ada2-4e97-9e6f-ce18d749b2d4+7:13932:x1874675275774592:12345-192.168.201.51@tcp:101:mkdir.0 Request processed in 2465us (9188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830050.612850:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 14 00000100:00100000:1.0:1787830050.658726:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fe7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284152576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787830050.658831:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830050.658984:0:15018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284152576 00000100:00100000:2.0:1787830050.658993:0:15018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284152576 00000100:00100000:2.0:1787830050.659094:0:15018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787830050.659105:0:15018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f99a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284152576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787830050.659133:0:15018:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787830050.659180:0:15018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f99a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284152576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830050.659187:0:15018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787830050.659565:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fe7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284152576:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787830050.663120:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787830051.619911:0:15985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830052.194380:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284152704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787830052.194488:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830052.194629:0:15018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284152704 00000100:00100000:0.0:1787830052.194639:0:15018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284152704 00000100:00100000:0.0:1787830052.194718:0:15018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787830052.194728:0:15018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f999a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284152704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787830052.194775:0:15018:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787830052.194828:0:15018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f999a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284152704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830052.194836:0:15018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1787830052.194889:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787830052.194929:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284152704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787830052.198693:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3280:1874675284152832:0@lo:400:kworker.0 00000100:00100000:1.0:1787830052.198795:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830052.198855:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1874675284153344:0@lo:400:kworker.0 00000100:00100000:1.0:1787830052.198885:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830052.198916:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787830052.198922:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284152960:0@lo:400:kworker.0 00000100:00100000:1.0:1787830052.198952:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830052.198988:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284153344 00000100:00100000:1.0:1787830052.199008:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284153344 00000100:00100000:1.0:1787830052.199186:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787830052.199198:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f998780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874675284153344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830052.199262:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f998780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874675284153344:12345-0@lo:400:kworker.0 Request processed in 66us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830052.199269:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787830052.199318:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284153088:0@lo:400:kworker.0 00000100:00100000:1.0:1787830052.199348:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830052.199367:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787830052.199373:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284153216:0@lo:400:kworker.0 00000100:00100000:1.0:1787830052.199396:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787830052.199419:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787830052.199429:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284153088 00000100:00100000:1.0:1787830052.199432:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284153088 00000100:00100000:1.0:1787830052.199453:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284153216 00000100:00100000:1.0:1787830052.199468:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284153216 00000100:00100000:1.0:1787830052.199491:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787830052.199496:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284153088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830052.199530:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284153088:12345-0@lo:400:kworker.0 Request processed in 33us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830052.199536:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787830052.199548:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787830052.199554:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f99b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284153216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830052.199580:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f99b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284153216:12345-0@lo:400:kworker.0 Request processed in 26us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830052.199585:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1787830052.199600:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787830052.199634:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284153216:0@lo:400:kworker.0 00000100:00100000:1.0:1787830052.199646:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284153088:0@lo:400:kworker.0 00000100:00100000:1.0:1787830052.199682:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1874675284153344:0@lo:400:kworker.0 00000100:00100000:0.0:1787830052.199779:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284152832 00000100:00100000:0.0:1787830052.199784:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284152832 00000100:00100000:0.0:1787830052.199814:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787830052.199830:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:3280:x1874675284152832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830052.199868:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:3280:x1874675284152832:12345-0@lo:400:kworker.0 Request processed in 40us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830052.199874:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787830052.199906:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284152960 00000100:00100000:0.0:1787830052.199910:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284152960 00000100:00100000:0.0:1787830052.199949:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787830052.199955:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f998b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284152960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830052.199984:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f998b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284152960:12345-0@lo:400:kworker.0 Request processed in 30us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830052.199990:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1787830052.202389:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787830052.202490:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284152960:0@lo:400:kworker.0 00000100:00100000:1.0:1787830052.202535:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3280:1874675284152832:0@lo:400:kworker.0 00010000:00010000:2.0:1787830052.643129:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787830052.798936:0:7602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 612b807d-ada2-4e97-9e6f-ce18d749b2d4 00000001:00100000:3.0:1787830052.801051:0:5827:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 612b807d-ada2-4e97-9e6f-ce18d749b2d4 00000001:00100000:3.0:1787830052.801068:0:5827:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bad48885-a767-440f-85b6-3e1bee305ba5 00000001:00100000:0.0:1787830052.814050:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 612b807d-ada2-4e97-9e6f-ce18d749b2d4 00000001:02000400:2.0:1787830053.636612:0:16300:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787830053.666226:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830054.690325:0:15985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830055.710520:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830055.710650:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830055.710861:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275774848 00000100:00100000:3.0:1787830055.710871:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275774848 00000100:00100000:3.0:1787830055.710963:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 21 00000100:00100000:3.0:1787830055.710974:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5455a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+6:2360:x1874675275774848:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787830055.711077:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5455a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+6:2360:x1874675275774848:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 105us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830055.711085:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 21 00000100:00080000:0.0:1787830055.711253:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787830055.714357:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830055.714628:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830055.714677:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830055.714706:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830055.714712:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275774720 00000100:00100000:1.0:1787830055.714726:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275774720 00000100:00100000:1.0:1787830055.714775:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 105 00000100:00100000:1.0:1787830055.714785:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c47ee9c-623b-47d7-a235-c0ef434319ba+13:2360:x1874675275774720:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:1.0:1787830055.714851:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c47ee9c-623b-47d7-a235-c0ef434319ba+13:2360:x1874675275774720:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 68us (4341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830055.714859:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 105 00000100:00100000:0.0:1787830055.715173:0:15414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275775104 00000100:00100000:0.0:1787830055.715178:0:15414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275775104 00000100:00100000:0.0:1787830055.715217:0:15414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275775360 00000100:00100000:0.0:1787830055.715221:0:15414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275775360 00000100:00100000:0.0:1787830055.715245:0:15414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 7 00000100:00100000:0.0:1787830055.715253:0:15414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bad48885-a767-440f-85b6-3e1bee305ba5+5:2361:x1874675275775104:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787830055.715289:0:15414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bad48885-a767-440f-85b6-3e1bee305ba5+5:2361:x1874675275775104:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 37us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830055.715294:0:15414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 7 00000100:00100000:0.0:1787830055.715306:0:15414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 8 00000100:00100000:0.0:1787830055.715311:0:15414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:612b807d-ada2-4e97-9e6f-ce18d749b2d4+5:2361:x1874675275775360:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787830055.715330:0:15414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:612b807d-ada2-4e97-9e6f-ce18d749b2d4+5:2361:x1874675275775360:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 19us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830055.715348:0:15414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 8 00000100:00080000:1.0:1787830055.715419:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787830055.715424:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787830055.716376:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830055.716607:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275775232 00000100:00100000:2.0:1787830055.716611:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275774976 00000100:00100000:1.0:1787830055.716613:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275775232 00000100:00100000:2.0:1787830055.716614:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275774976 00000100:00100000:1.0:1787830055.716677:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 22 00000100:00100000:1.0:1787830055.716686:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:612b807d-ada2-4e97-9e6f-ce18d749b2d4+6:2361:x1874675275775232:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787830055.716728:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830055.716736:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:612b807d-ada2-4e97-9e6f-ce18d749b2d4+6:2361:x1874675275775232:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 52us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830055.716743:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 22 00000100:00100000:3.0:1787830055.716785:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275775488 00000100:00100000:3.0:1787830055.716789:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275775488 00000100:00100000:2.0:1787830055.718175:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 9 00000100:00100000:2.0:1787830055.718188:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bad48885-a767-440f-85b6-3e1bee305ba5+5:2361:x1874675275774976:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787830055.718252:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bad48885-a767-440f-85b6-3e1bee305ba5+5:2361:x1874675275774976:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 67us (3544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830055.718259:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 9 00000100:00080000:1.0:1787830055.719834:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787830055.719842:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787830055.719845:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787830055.720549:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 10 00000100:00100000:3.0:1787830055.720567:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:612b807d-ada2-4e97-9e6f-ce18d749b2d4+5:2361:x1874675275775488:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787830055.720678:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:612b807d-ada2-4e97-9e6f-ce18d749b2d4+5:2361:x1874675275775488:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 117us (3950us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830055.723775:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 10 00000100:00100000:2.0:1787830055.778494:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fe79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284153472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787830055.778572:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830055.778856:0:15018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284153472 00000100:00100000:0.0:1787830055.778865:0:15018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284153472 00000100:00100000:0.0:1787830055.778932:0:15018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787830055.778943:0:15018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284153472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787830055.778981:0:15018:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787830055.779059:0:15018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284153472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830055.779067:0:15018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787830055.779119:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fe79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284153472:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787830055.779138:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1787830056.356134:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787830056.738360:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830057.314312:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f383c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284153600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787830057.314449:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830057.314668:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284153600 00000100:00100000:2.0:1787830057.314679:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284153600 00000100:00100000:2.0:1787830057.314761:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787830057.315313:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284153600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787830057.315377:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787830057.315470:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284153600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 699us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830057.315480:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787830057.315806:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fe79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284153856:0@lo:400:kworker.0 00000100:00100000:3.0:1787830057.315858:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830057.315895:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787830057.315901:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fb63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874675284153984:0@lo:400:kworker.0 00000100:00100000:3.0:1787830057.315944:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830057.315981:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284153856 00000100:00100000:3.0:1787830057.315988:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284153856 00000100:00100000:3.0:1787830057.316058:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787830057.316069:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284153856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830057.316121:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1874675284153856:12345-0@lo:400:kworker.0 Request processed in 55us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830057.316127:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787830057.316150:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284153984 00000100:00100000:3.0:1787830057.316153:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284153984 00000100:00100000:3.0:1787830057.316182:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787830057.316188:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874675284153984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830057.316217:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874675284153984:12345-0@lo:400:kworker.0 Request processed in 30us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830057.316223:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787830057.316286:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fb63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874675284153984:0@lo:400:kworker.0 00000100:00100000:3.0:1787830057.316298:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fe79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1874675284153856:0@lo:400:kworker.0 00000100:00100000:3.0:1787830057.316329:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fb63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284154112:0@lo:400:kworker.0 00000100:00100000:3.0:1787830057.316380:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830057.316424:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f383c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284153600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787830057.316443:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787830057.316449:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fe78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3278:1874675284153728:0@lo:400:kworker.0 00000100:00100000:3.0:1787830057.316480:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830057.316508:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fb60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284154240:0@lo:400:kworker.0 00000100:00100000:3.0:1787830057.316532:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830057.316557:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284154112 00000100:00100000:3.0:1787830057.316561:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284154112 00000100:00100000:3.0:1787830057.316585:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284154240 00000100:00100000:3.0:1787830057.316588:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284154240 00000100:00100000:3.0:1787830057.316606:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787830057.316613:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284154112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830057.316652:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1874675284154112:12345-0@lo:400:kworker.0 Request processed in 39us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830057.316658:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787830057.316670:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787830057.316675:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1874675284154240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830057.316701:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1874675284154240:12345-0@lo:400:kworker.0 Request processed in 27us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830057.316706:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787830057.316731:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fb60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1874675284154240:0@lo:400:kworker.0 00000100:00100000:3.0:1787830057.316739:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fb63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1874675284154112:0@lo:400:kworker.0 00000100:00080000:1.0:1787830057.316849:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787830057.316862:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787830057.316863:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787830057.317284:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284153728 00000100:00100000:2.0:1787830057.317292:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284153728 00000100:00100000:2.0:1787830057.317339:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787830057.317347:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:3278:x1874675284153728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830057.317415:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:3278:x1874675284153728:12345-0@lo:400:kworker.0 Request processed in 68us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830057.317422:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787830057.317625:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fe78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3278:1874675284153728:0@lo:400:kworker.0 00000020:00000080:3.0:1787830057.546155:0:16447:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe22760750 20000000:00000080:3.0:1787830057.546180:0:16447:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e9b6fda8c00 uarg=0000000000000000 20000000:01000000:3.0:1787830057.546237:0:16447:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787830057.546246:0:16447:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787830057.546260:0:16447:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787830057.547542:0:16448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1787830057.547717:0:16447:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787830057.556354:0:16447:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787830057.556762:0:16447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e9b7feef400/0xc03b4d103c0d8c45 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830057.558818:0:16447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b7fa7e200/0xc03b4d103c0d893c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d8935 expref: 18 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830057.558831:0:16447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b74e3f400/0xc03b4d103c0d8989 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d8982 expref: 18 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830057.559498:0:16447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b74898400/0xc03b4d103c0d8abd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d8ab6 expref: 18 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830057.559518:0:16447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b7feee600/0xc03b4d103c0d8be3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b6e expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830057.559526:0:16447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9a437bd600/0xc03b4d103c0d8c1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8bd0 expref: 12 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830057.559537:0:16447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e9b7feef400/0xc03b4d103c0d8c45 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830057.559619:0:16447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9a437bd600/0xc03b4d103c0d8c1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8bd0 expref: 12 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830057.559637:0:16447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9a437bd600/0xc03b4d103c0d8c1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8bd0 expref: 12 pid: 14322 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830057.559657:0:16447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5455a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16447:1874675284154368:192.168.201.51@tcp:104: 00010000:00010000:1.0:1787830057.559816:0:16447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b7feee600/0xc03b4d103c0d8be3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8b6e expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830057.559856:0:16447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9b7feee600/0xc03b4d103c0d8be3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8b6e expref: 12 pid: 14323 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830057.559867:0:16447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b52385a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16447:1874675284154496:192.168.201.51@tcp:104: 00010000:00010000:1.0:1787830057.560104:0:16447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b74898400/0xc03b4d103c0d8abd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d8ab6 expref: 18 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830057.560115:0:16447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9b74898400/0xc03b4d103c0d8abd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d8ab6 expref: 18 pid: 14321 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830057.560127:0:16447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b52385e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16447:1874675284154624:0@lo:104: 00000100:00100000:1.0:1787830057.560177:0:16447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787830057.560220:0:16447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b74e3f400/0xc03b4d103c0d8989 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d8982 expref: 18 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830057.560229:0:16447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9b74e3f400/0xc03b4d103c0d8989 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d8982 expref: 18 pid: 14322 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830057.560237:0:16447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b52384000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16447:1874675284154752:0@lo:104: 00000100:00100000:1.0:1787830057.560261:0:16447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787830057.560285:0:16447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b7fa7e200/0xc03b4d103c0d893c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc03b4d103c0d8935 expref: 18 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830057.560294:0:16447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9b7fa7e200/0xc03b4d103c0d893c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc03b4d103c0d8935 expref: 18 pid: 14323 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830057.560302:0:16447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b52387840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16447:1874675284154880:0@lo:104: 00000100:00100000:1.0:1787830057.560331:0:16447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830057.560352:0:16447:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b69e3e000 going to sleep for 11 seconds 00000100:00100000:2.0:1787830057.560375:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787830057.560400:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284154624 00000100:00100000:2.0:1787830057.560417:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284154624 00000100:00100000:0.0:1787830057.560451:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284154752 00000100:00100000:0.0:1787830057.560458:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284154752 00000100:00100000:2.0:1787830057.560474:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284154880 00000100:00100000:2.0:1787830057.560479:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284154880 00000100:00100000:0.0:1787830057.560495:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787830057.560509:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b523852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+5:16447:x1874675284154624:12345-0@lo:104: 00010000:00010000:0.0:1787830057.560524:0:14312:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e000/0xc03b4d103c0d8ab6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d8abd expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830057.560609:0:14312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787830057.560615:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b523852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+5:16447:x1874675284154624:12345-0@lo:104: Request processed in 111us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830057.560624:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787830057.560648:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787830057.560654:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52386940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+4:16447:x1874675284154752:12345-0@lo:104: 00010000:00010000:0.0:1787830057.560662:0:14312:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b74898c00/0xc03b4d103c0d8982 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d8989 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830057.560707:0:14312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787830057.560712:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52386940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+4:16447:x1874675284154752:12345-0@lo:104: Request processed in 59us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830057.560719:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787830057.560735:0:15985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1787830057.560736:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787830057.560748:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6e970450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+3:16447:x1874675284154880:12345-0@lo:104: 00010000:00010000:2.0:1787830057.560749:0:15985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e000/0xc03b4d103c0d8ab6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d8abd expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830057.560758:0:14312:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e800/0xc03b4d103c0d8935 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d893c expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830057.560767:0:15985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3e000 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:2.0:1787830057.560774:0:15985:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e000/0xc03b4d103c0d8ab6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d8abd expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830057.560786:0:15985:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e000/0xc03b4d103c0d8ab6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d8abd expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787830057.560795:0:15985:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e000/0xc03b4d103c0d8ab6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d8abd expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830057.560796:0:14312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787830057.560807:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6e970450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+3:16447:x1874675284154880:12345-0@lo:104: Request processed in 60us (474us total) trans 0 rc 0/0 10000000:01000000:2.0:1787830057.560808:0:15985:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1787830057.560819:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787830057.560862:0:15985:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e000/0xc03b4d103c0d8ab6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d8abd expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830057.560866:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787830057.560874:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b74898c00/0xc03b4d103c0d8982 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d8989 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830057.560875:0:15985:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787830057.560884:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74898c00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:0.0:1787830057.560888:0:14317:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b74898c00/0xc03b4d103c0d8982 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d8989 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830057.560896:0:14317:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b74898c00/0xc03b4d103c0d8982 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d8989 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830057.560913:0:15985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e000/0xc03b4d103c0d8ab6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d8abd expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830057.560922:0:15985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e000/0xc03b4d103c0d8ab6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d8abd expref: -99 pid: 15732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830057.560936:0:15985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830057.560940:0:15985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e800/0xc03b4d103c0d8935 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc03b4d103c0d893c expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830057.560958:0:15985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b74e3e800 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:2.0:1787830057.560961:0:15985:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e800/0xc03b4d103c0d8935 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc03b4d103c0d893c expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830057.560968:0:15985:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e800/0xc03b4d103c0d8935 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc03b4d103c0d893c expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787830057.560975:0:15985:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e800/0xc03b4d103c0d8935 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d893c expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830057.560980:0:15985:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787830057.560996:0:15985:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e800/0xc03b4d103c0d8935 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d893c expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830057.561002:0:15985:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787830057.561008:0:15985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e800/0xc03b4d103c0d8935 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d893c expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830057.561045:0:15985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b74e3e800/0xc03b4d103c0d8935 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d893c expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830057.561057:0:15985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830057.561059:0:15985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830057.561061:0:15985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830057.561068:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830057.561089:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f383480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3280:1874675284155008:0@lo:103:ldlm_bl.0 10000000:00010000:0.0:1787830057.561112:0:14317:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.151@tcp lock: ffff9e9b74898c00/0xc03b4d103c0d8982 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc03b4d103c0d8989 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830057.561120:0:14317:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1787830057.561132:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787830057.561156:0:14317:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.151@tcp lock: ffff9e9b74898c00/0xc03b4d103c0d8982 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d8989 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830057.561165:0:14317:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787830057.561171:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787830057.561180:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f3803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3280:1874675284155136:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787830057.561187:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.151@tcp lock: ffff9e9b74898c00/0xc03b4d103c0d8982 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d8989 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830057.561197:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.151@tcp lock: ffff9e9b74898c00/0xc03b4d103c0d8982 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc03b4d103c0d8989 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830057.561214:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830057.561218:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787830057.561218:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830057.561224:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830057.561240:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3278:1874675284155264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787830057.561277:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284155008 00000100:00100000:0.0:1787830057.561277:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830057.561283:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284155008 00010000:00010000:2.0:1787830057.561307:0:14313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b74898400/0xc03b4d103c0d8abd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d8ab6 expref: 19 pid: 14321 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830057.561322:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284155136 00000100:00100000:2.0:1787830057.561326:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284155264 00000100:00100000:0.0:1787830057.561328:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284155136 00000100:00100000:2.0:1787830057.561332:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284155264 00010000:00010000:0.0:1787830057.561348:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b7fa7e200/0xc03b4d103c0d893c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d8935 expref: 21 pid: 14323 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830057.561351:0:14313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b74e3f400/0xc03b4d103c0d8989 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d8982 expref: 21 pid: 14322 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830057.561389:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787830057.561459:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787830057.561468:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f380000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+21:3280:x1874675284155136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787830057.561482:0:14313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830057.561488:0:14313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b7fa7e200/0xc03b4d103c0d893c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d8935 expref: 21 pid: 14323 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830057.561499:0:14313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b7fa7e200/0xc03b4d103c0d893c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d8935 expref: 21 pid: 14323 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830057.561521:0:14313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830057.561555:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f380000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+21:3280:x1874675284155136:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830057.561562:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787830057.561575:0:14313:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787830057.561582:0:14313:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1787830057.561608:0:14314:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787830057.561619:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787830057.561625:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7a7a7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+20:3278:x1874675284155264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787830057.561633:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830057.561644:0:14314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b74e3f400/0xc03b4d103c0d8989 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d8982 expref: 20 pid: 14322 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830057.561654:0:14314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b74e3f400/0xc03b4d103c0d8989 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d8982 expref: 20 pid: 14322 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830057.561664:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830057.561693:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7a7a7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+20:3278:x1874675284155264:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830057.561700:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787830057.561779:0:16447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b52385e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16447:1874675284154624:0@lo:104: 00010000:00010000:1.0:1787830057.561794:0:16447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b74e3f400/0xc03b4d103c0d8989 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d8982 expref: 19 pid: 14322 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830057.561807:0:16447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b52384000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16447:1874675284154752:0@lo:104: 00010000:00010000:1.0:1787830057.561819:0:16447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b7fa7e200/0xc03b4d103c0d893c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d8935 expref: 18 pid: 14323 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830057.561831:0:16447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b52387840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16447:1874675284154880:0@lo:104: 00000100:00100000:2.0:1787830057.561839:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3278:1874675284155264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787830057.561869:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f3803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3280:1874675284155136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787830057.562359:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3812c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+17:3280:x1874675284155008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787830057.562380:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830057.562385:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b74898400/0xc03b4d103c0d8abd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc03b4d103c0d8ab6 expref: 17 pid: 14321 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830057.562395:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b74898400/0xc03b4d103c0d8abd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc03b4d103c0d8ab6 expref: 17 pid: 14321 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830057.562408:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b74898400/0xc03b4d103c0d8abd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc03b4d103c0d8ab6 expref: 17 pid: 14321 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830057.562429:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830057.562486:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3812c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+16:3280:x1874675284155008:12345-0@lo:103:ldlm_bl.0 Request processed in 1089us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830057.562494:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787830057.562691:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f383480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3280:1874675284155008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787830057.570958:0:16447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5455a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16447:1874675284154368:192.168.201.51@tcp:104: 00000100:00100000:1.0:1787830057.570979:0:16447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b52385a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16447:1874675284154496:192.168.201.51@tcp:104: 00010000:00010000:1.0:1787830057.571047:0:16447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e9b7feef400/0xc03b4d103c0d8c45 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830057.575221:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830057.575790:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275775744 00000100:00100000:0.0:1787830057.575804:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275775744 00010000:00010000:0.0:1787830057.575862:0:14314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b7feee600/0xc03b4d103c0d8be3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8b6e expref: 13 pid: 14323 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830057.575903:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 7 00000100:00100000:0.0:1787830057.575915:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3803c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c47ee9c-623b-47d7-a235-c0ef434319ba+13:2360:x1874675275775744:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787830057.575936:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830057.575942:0:14314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b7feee600/0xc03b4d103c0d8be3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8b6e expref: 13 pid: 14323 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830057.575956:0:14314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b7feee600/0xc03b4d103c0d8be3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8b6e expref: 13 pid: 14323 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830057.575980:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b7feee600/0xc03b4d103c0d8be3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8b6e expref: 13 pid: 14323 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830057.576001:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830057.576089:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3803c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c47ee9c-623b-47d7-a235-c0ef434319ba+12:2360:x1874675275775744:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 176us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830057.576099:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 7 00000100:00100000:3.0:1787830057.579325:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830057.579623:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275775616 00000100:00100000:0.0:1787830057.579643:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275775616 00010000:00010000:0.0:1787830057.579720:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9a437bd600/0xc03b4d103c0d8c1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8bd0 expref: 12 pid: 14322 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830057.579814:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 8 00000100:00100000:0.0:1787830057.579826:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb63840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c47ee9c-623b-47d7-a235-c0ef434319ba+12:2362:x1874675275775616:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787830057.579846:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830057.579854:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9a437bd600/0xc03b4d103c0d8c1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8bd0 expref: 12 pid: 14322 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830057.579869:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9a437bd600/0xc03b4d103c0d8c1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8bd0 expref: 12 pid: 14322 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830057.579891:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9a437bd600/0xc03b4d103c0d8c1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8bd0 expref: 12 pid: 14322 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830057.579913:0:14315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e9b7feef400/0xc03b4d103c0d8c45 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830057.579924:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b7feef400/0xc03b4d103c0d8c45 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830057.579945:0:14315:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b7feef400/0xc03b4d103c0d8c45 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830057.579953:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b7feef400/0xc03b4d103c0d8c45 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830057.579961:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e9b7feef400/0xc03b4d103c0d8c45 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830057.579968:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e9b7feef400/0xc03b4d103c0d8c45 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830057.579984:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feef400 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787830057.579990:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e9b7feef400/0xc03b4d103c0d8c45 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830057.579999:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e9b7feef400/0xc03b4d103c0d8c45 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830057.580068:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e9b7feef400/0xc03b4d103c0d8c45 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830057.580082:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787830057.580092:0:16447:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e9b7feef400/0xc03b4d103c0d8c45 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830057.580105:0:16447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e9b7feef400/0xc03b4d103c0d8c45 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830057.580113:0:16447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b7feef400/0xc03b4d103c0d8c45 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830057.580154:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb63840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c47ee9c-623b-47d7-a235-c0ef434319ba+11:2362:x1874675275775616:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 330us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830057.580164:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 8 00010000:00010000:2.0:1787830057.765327:0:15985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787830058.661010:0:14325:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787830058.661036:0:14325:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9b7f520000 from 10 10000000:01000000:2.0:1787830058.661043:0:14325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787830058.661111:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9a437bc200/0xc03b4d103c0d8c4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830058.661125:0:14325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9a437bc200/0xc03b4d103c0d8c4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830058.661138:0:14325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9a437bc200/0xc03b4d103c0d8c4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830058.661172:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f380f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284155392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787830058.661269:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830058.661332:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b6fa50240 going to sleep for 11 seconds 00000100:00100000:2.0:1787830058.661390:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284155392 00000100:00100000:2.0:1787830058.661398:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284155392 00000100:00100000:2.0:1787830058.661459:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787830058.661467:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+16:14325:x1874675284155392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787830058.661484:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830058.661500:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9a437bc600/0xc03b4d103c0d8c53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d8c4c expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830058.661528:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9a437bc600/0xc03b4d103c0d8c53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d8c4c expref: 17 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830058.661539:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9a437bc600/0xc03b4d103c0d8c53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d8c4c expref: 17 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830058.661549:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9a437bc600, rc 0) 00000100:00100000:2.0:1787830058.661592:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+17:14325:x1874675284155392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830058.661600:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787830058.661757:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f380f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284155392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787830058.661775:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9a437bc200/0xc03b4d103c0d8c4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8c53 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830058.661784:0:14325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9a437bc200/0xc03b4d103c0d8c4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d8c53 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830058.661849:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f380f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284155520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787830058.661875:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830058.661892:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4f8dc240 going to sleep for 11 seconds 00000100:00100000:2.0:1787830058.661918:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284155520 00000100:00100000:2.0:1787830058.661923:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284155520 00000100:00100000:2.0:1787830058.661952:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787830058.661959:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+17:14325:x1874675284155520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787830058.662295:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+17:14325:x1874675284155520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 336us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830058.662304:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787830058.662338:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f380f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284155520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787830058.662384:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f380f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284155648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787830058.662429:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830058.662443:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4f8dc240 going to sleep for 11 seconds 00000100:00100000:2.0:1787830058.662455:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284155648 00000100:00100000:2.0:1787830058.662458:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284155648 00000100:00100000:2.0:1787830058.662482:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787830058.662489:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+17:14325:x1874675284155648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787830058.662652:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+17:14325:x1874675284155648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830058.662660:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787830058.662699:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f380f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284155648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787830058.663391:0:16470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787830058.663456:0:14325:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787830058.663477:0:14325:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787830058.663487:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9a437bc200/0xc03b4d103c0d8c4c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8c53 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830058.663497:0:14325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9a437bc200/0xc03b4d103c0d8c4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8c53 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830058.663517:0:14325:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787830058.663520:0:14325:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9b50685800 from 10 10000000:01000000:2.0:1787830058.663523:0:14325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787830058.663552:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9a437bc800/0xc03b4d103c0d8c5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830058.663561:0:14325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9a437bc800/0xc03b4d103c0d8c5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830058.663571:0:14325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9a437bc800/0xc03b4d103c0d8c5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830058.663590:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f380f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284155776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787830058.663635:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830058.663655:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4f8dc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830058.663673:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284155776 00000100:00100000:2.0:1787830058.663679:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284155776 00000100:00100000:2.0:1787830058.663714:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787830058.663722:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+17:14325:x1874675284155776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787830058.663733:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830058.663746:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9a437bdc00/0xc03b4d103c0d8c61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d8c5a expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830058.663768:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9a437bdc00/0xc03b4d103c0d8c61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d8c5a expref: 18 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830058.663779:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9a437bdc00/0xc03b4d103c0d8c61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d8c5a expref: 18 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830058.663798:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9a437bdc00, rc 0) 00000100:00100000:2.0:1787830058.663828:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+18:14325:x1874675284155776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830058.663835:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787830058.663870:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f380f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284155776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787830058.663882:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9a437bc800/0xc03b4d103c0d8c5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8c61 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830058.663891:0:14325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9a437bc800/0xc03b4d103c0d8c5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d8c61 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830058.663932:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f380f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284155904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787830058.663952:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830058.663963:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4f8dc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830058.663973:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284155904 00000100:00100000:2.0:1787830058.663976:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284155904 00000100:00100000:2.0:1787830058.663993:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787830058.663999:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+18:14325:x1874675284155904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787830058.664248:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+18:14325:x1874675284155904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830058.664255:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787830058.664281:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f380f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284155904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787830058.664306:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f380f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284156032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787830058.673693:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830058.673849:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4f8dc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830058.674734:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284156032 00000100:00100000:3.0:1787830058.674748:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284156032 00000100:00100000:2.0:1787830058.675249:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787830058.675264:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+18:14325:x1874675284156032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787830058.676602:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+18:14325:x1874675284156032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1333us (12250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830058.676616:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787830058.677474:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f380f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284156032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787830058.681258:0:16472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787830058.683487:0:14325:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787830058.683537:0:14325:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787830058.683554:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9a437bc800/0xc03b4d103c0d8c5a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8c61 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830058.683663:0:14325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9a437bc800/0xc03b4d103c0d8c5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8c61 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830058.683677:0:14325:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787830058.683681:0:14325:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9b44e11000 from 10 10000000:01000000:2.0:1787830058.683684:0:14325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787830058.683736:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9a437bd000/0xc03b4d103c0d8c68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830058.683745:0:14325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.151@tcp lock: ffff9e9a437bd000/0xc03b4d103c0d8c68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830058.683759:0:14325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.151@tcp lock: ffff9e9a437bd000/0xc03b4d103c0d8c68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830058.683791:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f382580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284156160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787830058.684358:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830058.684424:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b69da0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787830058.684512:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284156160 00000100:00100000:3.0:1787830058.684520:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284156160 00000100:00100000:3.0:1787830058.684595:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787830058.684606:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5390f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+18:14325:x1874675284156160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787830058.684625:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830058.684643:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b40030a00/0xc03b4d103c0d8c6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03b4d103c0d8c68 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830058.684671:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b40030a00/0xc03b4d103c0d8c6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc03b4d103c0d8c68 expref: 19 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830058.684682:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b40030a00/0xc03b4d103c0d8c6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc03b4d103c0d8c68 expref: 19 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830058.684691:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b40030a00, rc 0) 00000100:00100000:3.0:1787830058.684746:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5390f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:14325:x1874675284156160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830058.684753:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787830058.687399:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f382580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284156160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787830058.687440:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.151@tcp lock: ffff9e9a437bd000/0xc03b4d103c0d8c68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8c6f expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830058.687481:0:14325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.151@tcp lock: ffff9e9a437bd000/0xc03b4d103c0d8c68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc03b4d103c0d8c6f expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830058.687588:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b52385a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284156288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787830058.687667:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830058.687722:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b69e3e000 going to sleep for 11 seconds 00000100:00100000:2.0:1787830058.687915:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284156288 00000100:00100000:2.0:1787830058.687922:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284156288 00000100:00100000:2.0:1787830058.687996:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787830058.688006:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6f5fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:14325:x1874675284156288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787830058.688391:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6f5fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:14325:x1874675284156288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 385us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830058.688399:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787830058.689421:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b52385a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284156288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787830058.689478:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b52385a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284156416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787830058.689545:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830058.689593:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b69e3e000 going to sleep for 11 seconds 00000100:00100000:2.0:1787830058.689694:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284156416 00000100:00100000:2.0:1787830058.689701:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284156416 00000100:00100000:2.0:1787830058.689795:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787830058.689805:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6f5ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:14325:x1874675284156416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787830058.690067:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6f5ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:14325:x1874675284156416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 263us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830058.690075:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787830058.690163:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b52385a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:14325:1874675284156416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787830058.694804:0:16473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787830058.696771:0:14325:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787830058.696828:0:14325:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787830058.696842:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.151@tcp lock: ffff9e9a437bd000/0xc03b4d103c0d8c68 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8c6f expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830058.696857:0:14325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.151@tcp lock: ffff9e9a437bd000/0xc03b4d103c0d8c68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc03b4d103c0d8c6f expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830058.786199:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830059.299425:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830059.299747:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275775872 00000100:00100000:0.0:1787830059.299758:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275775872 00000100:00100000:0.0:1787830059.299821:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 116 00000100:00100000:0.0:1787830059.299832:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6f5fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c47ee9c-623b-47d7-a235-c0ef434319ba+11:13785:x1874675275775872:12345-192.168.201.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787830059.299851:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830059.299872:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b6fd07400/0xc03b4d103c0d8c76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x53172783628c8c01 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830059.299904:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b6fd07400/0xc03b4d103c0d8c76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c01 expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830059.299927:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b6fd07400/0xc03b4d103c0d8c76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c01 expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830059.299936:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b6fd07400, rc 0) 00000100:00100000:0.0:1787830059.299992:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6f5fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c47ee9c-623b-47d7-a235-c0ef434319ba+12:13785:x1874675275775872:12345-192.168.201.51@tcp:101:ll_cfg_requeue.0 Request processed in 162us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830059.300000:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 116 00000100:00100000:1.0:1787830059.303012:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830059.303203:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275776000 00000100:00100000:2.0:1787830059.303214:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275776000 00000100:00100000:2.0:1787830059.303272:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 117 00000100:00100000:2.0:1787830059.303282:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6f5fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c47ee9c-623b-47d7-a235-c0ef434319ba+12:13785:x1874675275776000:12345-192.168.201.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787830059.303591:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6f5fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c47ee9c-623b-47d7-a235-c0ef434319ba+12:13785:x1874675275776000:12345-192.168.201.51@tcp:501:ll_cfg_requeue.0 Request processed in 310us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830059.303599:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 117 00000100:00100000:2.0:1787830059.312598:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830059.314447:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275776128 00000100:00100000:0.0:1787830059.314461:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275776128 00000100:00100000:0.0:1787830059.314531:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 118 00000100:00100000:0.0:1787830059.314541:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6f5ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c47ee9c-623b-47d7-a235-c0ef434319ba+12:13785:x1874675275776128:12345-192.168.201.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787830059.314799:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6f5ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c47ee9c-623b-47d7-a235-c0ef434319ba+12:13785:x1874675275776128:12345-192.168.201.51@tcp:503:ll_cfg_requeue.0 Request processed in 258us (2212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830059.314810:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 118 00000100:00100000:3.0:1787830059.340757:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830059.341843:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275776256 00000100:00100000:1.0:1787830059.341856:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275776256 00000100:00100000:1.0:1787830059.341928:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 119 00000100:00100000:1.0:1787830059.341938:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6f5fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c47ee9c-623b-47d7-a235-c0ef434319ba+12:13785:x1874675275776256:12345-192.168.201.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787830059.341955:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830059.341973:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b7feeea00/0xc03b4d103c0d8c7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x53172783628c8c08 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830059.342003:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b7feeea00/0xc03b4d103c0d8c7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c08 expref: 13 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830059.342014:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b7feeea00/0xc03b4d103c0d8c7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c08 expref: 13 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830059.342049:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feeea00, rc 0) 00000100:00100000:1.0:1787830059.342112:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6f5fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c47ee9c-623b-47d7-a235-c0ef434319ba+13:13785:x1874675275776256:12345-192.168.201.51@tcp:101:ll_cfg_requeue.0 Request processed in 174us (1362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830059.342122:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 119 00000100:00100000:0.0:1787830059.345935:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830059.345985:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275776384 00000100:00100000:0.0:1787830059.345994:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275776384 00000100:00100000:0.0:1787830059.346056:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 120 00000100:00100000:0.0:1787830059.346067:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6f5ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c47ee9c-623b-47d7-a235-c0ef434319ba+13:13785:x1874675275776384:12345-192.168.201.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787830059.346367:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6f5ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c47ee9c-623b-47d7-a235-c0ef434319ba+13:13785:x1874675275776384:12345-192.168.201.51@tcp:501:ll_cfg_requeue.0 Request processed in 301us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830059.346376:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 120 00000100:00100000:1.0:1787830059.356074:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830059.356821:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275776512 00000100:00100000:2.0:1787830059.356831:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275776512 00000100:00100000:2.0:1787830059.356888:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 121 00000100:00100000:2.0:1787830059.356899:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6f5fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c47ee9c-623b-47d7-a235-c0ef434319ba+13:13785:x1874675275776512:12345-192.168.201.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787830059.357138:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6f5fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c47ee9c-623b-47d7-a235-c0ef434319ba+13:13785:x1874675275776512:12345-192.168.201.51@tcp:503:ll_cfg_requeue.0 Request processed in 240us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830059.357146:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 121 00010000:00010000:0.0:1787830059.810237:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830060.831584:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830060.831628:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830060.831673:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830060.831688:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275776640 00000100:00100000:0.0:1787830060.831699:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275776640 00000100:00100000:3.0:1787830060.831709:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830060.831735:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830060.831756:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830060.831786:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 122 00000100:00100000:3.0:1787830060.831797:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830060.831802:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6f5ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c47ee9c-623b-47d7-a235-c0ef434319ba+13:2362:x1874675275776640:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787830060.831824:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275776896 00000100:00100000:3.0:1787830060.831829:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275776896 00000100:00100000:3.0:1787830060.831869:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275777408 00000100:00100000:3.0:1787830060.831872:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275777408 00000100:00100000:3.0:1787830060.831888:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275777024 00000100:00100000:0.0:1787830060.831889:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6f5ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c47ee9c-623b-47d7-a235-c0ef434319ba+13:2362:x1874675275776640:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 93us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830060.831892:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275777024 00000100:00100000:0.0:1787830060.831902:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 122 00000100:00100000:3.0:1787830060.831911:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275777280 00000100:00100000:3.0:1787830060.831914:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275777280 00000100:00100000:3.0:1787830060.831931:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 12 00000100:00100000:3.0:1787830060.831939:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bad48885-a767-440f-85b6-3e1bee305ba5+5:2362:x1874675275776896:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787830060.831968:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 13 00000100:00100000:0.0:1787830060.831980:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb61e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:612b807d-ada2-4e97-9e6f-ce18d749b2d4+5:2362:x1874675275777408:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787830060.832011:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb61e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:612b807d-ada2-4e97-9e6f-ce18d749b2d4+5:2362:x1874675275777408:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 35us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830060.832047:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 13 00000100:00100000:3.0:1787830060.832059:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bad48885-a767-440f-85b6-3e1bee305ba5+5:2362:x1874675275776896:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 32us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830060.832066:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 14 00000100:00100000:3.0:1787830060.832074:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 12 00000100:00100000:0.0:1787830060.832076:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bad48885-a767-440f-85b6-3e1bee305ba5+5:2362:x1874675275777024:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787830060.832100:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 15 00000100:00100000:0.0:1787830060.832106:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bad48885-a767-440f-85b6-3e1bee305ba5+5:2362:x1874675275777024:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 31us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830060.832112:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:612b807d-ada2-4e97-9e6f-ce18d749b2d4+5:2362:x1874675275777280:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787830060.832118:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 14 00000100:00100000:0.0:1787830060.832142:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275777152 00000100:00100000:3.0:1787830060.832148:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:612b807d-ada2-4e97-9e6f-ce18d749b2d4+5:2362:x1874675275777280:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 39us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830060.832148:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275777152 00000100:00100000:3.0:1787830060.832158:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 15 00000100:00100000:0.0:1787830060.832180:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275776768 00000100:00100000:0.0:1787830060.832184:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275776768 00000100:00100000:0.0:1787830060.832200:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 26 00000100:00100000:0.0:1787830060.832206:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:612b807d-ada2-4e97-9e6f-ce18d749b2d4+6:2362:x1874675275777152:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787830060.832234:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:612b807d-ada2-4e97-9e6f-ce18d749b2d4+6:2362:x1874675275777152:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 28us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830060.832240:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 26 00000100:00100000:0.0:1787830060.832251:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 27 00000100:00100000:0.0:1787830060.832265:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+6:2362:x1874675275776768:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:0.0:1787830060.832291:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+6:2362:x1874675275776768:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 28us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830060.832298:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 27 00000100:00080000:3.0:1787830060.832442:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787830060.832448:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787830060.832451:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787830060.836000:0:15985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830060.899252:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fb62580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284156544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787830060.899338:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830060.899723:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284156544 00000100:00100000:3.0:1787830060.899731:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284156544 00000100:00100000:3.0:1787830060.899802:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787830060.899813:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f381e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284156544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787830060.899850:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787830060.899962:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787830060.900011:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f381e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284156544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 200us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830060.900041:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787830060.902372:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fb62580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284156544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787830061.784153:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830061.791880:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275777536 00000100:00100000:0.0:1787830061.791896:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275777536 00000100:00100000:0.0:1787830061.791990:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 15 00000100:00100000:0.0:1787830061.792001:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f382d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+6:14445:x1874675275777536:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787830061.792038:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830061.792065:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06200/0xc03b4d103c0d8c84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8c0f expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.792153:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8c8b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.792166:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8c8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.792180:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8c8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.792930:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8c92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.798868:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8c92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.798887:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8c92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.802588:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06400/0xc03b4d103c0d8c99 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.802627:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06400/0xc03b4d103c0d8c99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.802642:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06400/0xc03b4d103c0d8c99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830061.802754:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787830061.802759:0:14329:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787830061.802883:0:14329:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06400/0xc03b4d103c0d8c99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.802897:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8c8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.802903:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8c8b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.802909:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8c8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.802915:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b6fd07600 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787830061.802920:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8c8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.802927:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8c8b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.807623:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b507a7600) 00010000:00010000:0.0:1787830061.807653:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830061.807664:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8c8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.807675:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8c8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.807698:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8c92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.807704:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8c92 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.807710:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8c92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.807716:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b6fd07a00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787830061.807720:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8c92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.807728:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8c92 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.808487:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9e9b478ea000) 00010000:00010000:0.0:1787830061.808493:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830061.808498:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8c92 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.808505:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8c92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.808568:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06200/0xc03b4d103c0d8c84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c0f expref: 8 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.808624:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06400/0xc03b4d103c0d8c99 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c0f expref: 7 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.808631:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e9b478ea800) 00010000:00010000:0.0:1787830061.808634:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787830061.808636:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b6fd06400, rc 0) 00000100:00100000:0.0:1787830061.808717:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f382d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+7:14445:x1874675275777536:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 16717us (24576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830061.808726:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 15 00000100:00100000:2.0:1787830061.823062:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830061.823530:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275777792 00000100:00100000:3.0:1787830061.823541:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275777792 00000100:00100000:3.0:1787830061.823623:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 16 00000100:00100000:3.0:1787830061.823634:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f381680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+7:14445:x1874675275777792:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787830061.823655:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830061.823681:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8ca0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8c16 expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830061.823773:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031800/0xc03b4d103c0d8ca7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830061.823787:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031800/0xc03b4d103c0d8ca7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830061.823811:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031800/0xc03b4d103c0d8ca7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830061.823877:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8cae lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830061.823884:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8cae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830061.823891:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8cae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830061.828688:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030600/0xc03b4d103c0d8cb5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830061.828713:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030600/0xc03b4d103c0d8cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830061.828724:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030600/0xc03b4d103c0d8cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830061.828748:0:14328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787830061.830226:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031800/0xc03b4d103c0d8ca7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.830239:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031800/0xc03b4d103c0d8ca7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.830247:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031800/0xc03b4d103c0d8ca7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.830253:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40031800 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787830061.830257:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031800/0xc03b4d103c0d8ca7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.830265:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031800/0xc03b4d103c0d8ca7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.830281:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e9b478ea800) 00010000:00010000:2.0:1787830061.830284:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830061.830298:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031800/0xc03b4d103c0d8ca7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.830305:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031800/0xc03b4d103c0d8ca7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.830326:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8cae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.830333:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8cae lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.830339:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8cae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.830343:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40031a00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787830061.830346:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8cae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.830352:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8cae lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.830360:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e9b478cc400) 00010000:00010000:2.0:1787830061.830362:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830061.830365:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8cae lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.830370:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8cae lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.835512:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8ca0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c16 expref: 10 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.835543:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030600/0xc03b4d103c0d8cb5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c16 expref: 9 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.836499:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e9b478cc100) 00010000:00010000:2.0:1787830061.836507:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830061.836513:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b40030600, rc 0) 00000100:00100000:2.0:1787830061.837524:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f381680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+9:14445:x1874675275777792:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 13884us (14465us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787830061.837536:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 16 00000100:00100000:2.0:1787830061.844389:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830061.844942:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275777920 00000100:00100000:0.0:1787830061.844953:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275777920 00000100:00100000:0.0:1787830061.845079:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 17 00000100:00100000:0.0:1787830061.845091:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f380b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+9:14445:x1874675275777920:12345-192.168.201.51@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787830061.845218:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f380b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+9:14445:x1874675275777920:12345-192.168.201.51@tcp:59:lhsmtool_posix.0 Request processed in 129us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830061.845225:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 17 00010000:00010000:2.0:1787830061.858348:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830061.859451:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830061.859540:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275778048 00000100:00100000:2.0:1787830061.859553:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275778048 00000100:00100000:2.0:1787830061.859632:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 18 00000100:00100000:2.0:1787830061.859642:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+9:14451:x1874675275778048:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:2.0:1787830061.859667:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830061.859691:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bca00/0xc03b4d103c0d8cc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8c1d expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.859762:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd400/0xc03b4d103c0d8cca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.859778:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd400/0xc03b4d103c0d8cca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.859792:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd400/0xc03b4d103c0d8cca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.859809:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bc000/0xc03b4d103c0d8cd1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.859844:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bc000/0xc03b4d103c0d8cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.859849:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bc000/0xc03b4d103c0d8cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.860710:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd400/0xc03b4d103c0d8cca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.860723:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd400/0xc03b4d103c0d8cca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.860730:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd400/0xc03b4d103c0d8cca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.860737:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9a437bd400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787830061.860741:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd400/0xc03b4d103c0d8cca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.860749:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd400/0xc03b4d103c0d8cca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.860766:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b507a7600) 00010000:00010000:2.0:1787830061.860769:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830061.860775:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd400/0xc03b4d103c0d8cca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.860782:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd400/0xc03b4d103c0d8cca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.860796:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bc000/0xc03b4d103c0d8cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.860809:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bc000/0xc03b4d103c0d8cd1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.860815:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bc000/0xc03b4d103c0d8cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.860821:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9a437bc000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787830061.860990:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bc000/0xc03b4d103c0d8cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.860997:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bc000/0xc03b4d103c0d8cd1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.861006:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e9b45193f00) 00010000:00010000:2.0:1787830061.861009:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830061.861012:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bc000/0xc03b4d103c0d8cd1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.861200:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bc000/0xc03b4d103c0d8cd1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.861261:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bca00/0xc03b4d103c0d8cc3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c1d expref: 10 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.861273:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b507a7600) 00010000:00010000:2.0:1787830061.861275:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830061.861279:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bca00/0xc03b4d103c0d8cc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c1d expref: 10 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.861312:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9a437bca00, rc 0) 00000100:00100000:2.0:1787830061.861413:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+9:14451:x1874675275778048:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 1770us (1972us total) trans 0 rc 301/301 00000100:00100000:2.0:1787830061.861422:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 18 00000100:00100000:2.0:1787830061.865756:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830061.865931:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275778176 00000100:00100000:0.0:1787830061.865944:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275778176 00000100:00100000:0.0:1787830061.866009:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 0 00000100:00100000:2.0:1787830061.866582:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bad48885-a767-440f-85b6-3e1bee305ba5+9:14451:x1874675275778176:12345-192.168.201.51@tcp:700:lfs.0 00000100:00100000:2.0:1787830061.866708:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bad48885-a767-440f-85b6-3e1bee305ba5+9:14451:x1874675275778176:12345-192.168.201.51@tcp:700:lfs.0 Request processed in 223us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830061.866721:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 0 00000100:00100000:3.0:1787830061.869136:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830061.869215:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275778432 00000100:00100000:0.0:1787830061.869226:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275778432 00000100:00100000:0.0:1787830061.869300:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 19 00000100:00100000:0.0:1787830061.869312:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+9:14451:x1874675275778432:12345-192.168.201.51@tcp:36:lfs.0 00010000:00010000:0.0:1787830061.869396:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830061.869447:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef200/0xc03b4d103c0d8c06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8b98 expref: 9 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.869470:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b507a7600) 00010000:00010000:0.0:1787830061.869477:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787830061.869758:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8cd8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.869773:0:14329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d8c3e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8bfa expref: 5 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.869784:0:14329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8cd8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.869836:0:14329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d8c3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8bfa expref: 5 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.869853:0:14329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d8c3e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8bfa expref: 5 pid: 14329 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830061.869867:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14329:1874675284156672:192.168.201.51@tcp:104: 00000100:00100000:0.0:1787830061.869986:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b42bd59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787830061.875582:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830061.876608:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14329:1874675284156672:192.168.201.51@tcp:104: 00010000:00010000:0.0:1787830061.876654:0:14329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8cd8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830061.878454:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275778560 00000100:00100000:2.0:1787830061.878469:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275778560 00010000:00010000:2.0:1787830061.878529:0:14314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d8c3e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8bfa expref: 6 pid: 14329 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830061.878622:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 9 00000100:00100000:2.0:1787830061.878631:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52387840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:612b807d-ada2-4e97-9e6f-ce18d749b2d4+6:2363:x1874675275778560:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830061.878652:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830061.878658:0:14314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d8c3e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8bfa expref: 6 pid: 14329 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.878671:0:14314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d8c3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8bfa expref: 6 pid: 14329 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.878695:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefc00/0xc03b4d103c0d8c3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8bfa expref: 6 pid: 14329 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.878727:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b507a7600) 00010000:00010000:2.0:1787830061.878732:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8cd8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.878740:0:14314:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8cd8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.878747:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8cd8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830061.878784:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830061.878863:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52387840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:612b807d-ada2-4e97-9e6f-ce18d749b2d4+5:2363:x1874675275778560:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 232us (3292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830061.878875:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 9 00010000:00010000:0.0:1787830061.879062:0:14329:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8cd8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.879084:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8cd8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.879113:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8cdf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.879124:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8cdf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.879132:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8cdf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830061.880888:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787830061.880908:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8cd8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.880920:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8cd8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.880928:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8cd8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.880935:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b6fd07a00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787830061.880941:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8cd8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.880948:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8cd8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.880966:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b507a7600) 00010000:00010000:0.0:1787830061.880969:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830061.880982:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8cd8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830061.880989:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8cd8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787830061.881013:0:14329:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e207d597 reply state 00000000824e06d1 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8cdf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830061.881076:0:14329:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787830061.881199:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+10:14451:x1874675275778432:12345-192.168.201.51@tcp:36:lfs.0 Request processed in 11884us (12065us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787830061.881208:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 19 00010000:00010000:3.0:1787830061.886432:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8cdf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830061.886451:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8cdf lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830061.886457:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8cdf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830061.886479:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b6fd07600 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787830061.886483:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8cdf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830061.886489:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8cdf lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830061.886506:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e9b478ea000) 00010000:00010000:3.0:1787830061.886508:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830061.886512:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8cdf lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830061.886517:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8cdf lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830062.010460:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830062.011960:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275778688 00000100:00100000:2.0:1787830062.011979:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275778688 00000100:00100000:2.0:1787830062.012125:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 20 00000100:00100000:2.0:1787830062.012142:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+9:14459:x1874675275778688:12345-192.168.201.51@tcp:101:lctl.0 00010000:00010000:2.0:1787830062.012175:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830062.012204:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bc000/0xc03b4d103c0d8ce6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8c24 expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830062.012311:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd400/0xc03b4d103c0d8ced lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830062.012329:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd400/0xc03b4d103c0d8ced lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830062.012365:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd400/0xc03b4d103c0d8ced lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787830062.012444:0:14328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787830062.012449:0:14328:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787830062.012500:0:14328:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd400/0xc03b4d103c0d8ced lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830062.012738:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bc000/0xc03b4d103c0d8ce6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c24 expref: 11 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830062.012761:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd400/0xc03b4d103c0d8ced lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c24 expref: 10 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830062.012770:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b45193f00) 00010000:00010000:2.0:1787830062.012773:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787830062.012778:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9a437bd400, rc 0) 00000100:00100000:2.0:1787830062.012873:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+10:14459:x1874675275778688:12345-192.168.201.51@tcp:101:lctl.0 Request processed in 738us (2429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830062.012881:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 20 00000100:00080000:1.0:1787830062.013070:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787830062.059975:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830062.060328:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275778816 00000100:00100000:0.0:1787830062.060341:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275778816 00000100:00100000:0.0:1787830062.060433:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 21 00000100:00100000:0.0:1787830062.060444:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:612b807d-ada2-4e97-9e6f-ce18d749b2d4+5:14460:x1874675275778816:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:0.0:1787830062.060474:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830062.060503:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06e00/0xc03b4d103c0d8cf4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8c2b expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.060609:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07e00/0xc03b4d103c0d8cfb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.060627:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07e00/0xc03b4d103c0d8cfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.060640:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07e00/0xc03b4d103c0d8cfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830062.060715:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787830062.060737:0:14329:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787830062.060777:0:14329:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07e00/0xc03b4d103c0d8cfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.060806:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06e00/0xc03b4d103c0d8cf4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c2b expref: 7 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.060828:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07e00/0xc03b4d103c0d8cfb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c2b expref: 6 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.060837:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b45193f00) 00010000:00010000:0.0:1787830062.060840:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787830062.060845:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b6fd07e00, rc 0) 00000100:00100000:0.0:1787830062.060928:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:612b807d-ada2-4e97-9e6f-ce18d749b2d4+6:14460:x1874675275778816:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 486us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830062.060936:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 21 00000100:00080000:1.0:1787830062.061013:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787830062.064934:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830062.065083:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275778944 00000100:00100000:3.0:1787830062.065096:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275778944 00000100:00100000:3.0:1787830062.065167:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 22 00000100:00100000:3.0:1787830062.065178:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:612b807d-ada2-4e97-9e6f-ce18d749b2d4+6:14460:x1874675275778944:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:3.0:1787830062.065207:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830062.065231:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8d02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8c32 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.065334:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8d09 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.065352:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8d09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.065387:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8d09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.065406:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8d10 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.065412:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8d10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.065417:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8d10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.068595:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8d17 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.068618:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8d17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.068629:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8d17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830062.068700:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787830062.068703:0:14330:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787830062.068730:0:14330:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8d17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.068744:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8d09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.068750:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8d09 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.068771:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8d09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.068776:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40031e00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787830062.068780:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8d09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.068788:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8d09 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.068799:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b45193f00) 00010000:00010000:3.0:1787830062.068802:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830062.068807:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8d09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.068812:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8d09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.068829:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8d10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.068834:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8d10 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.070469:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8d10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.070487:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40031200 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787830062.070492:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8d10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.070519:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8d10 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.070536:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e9b478ccb00) 00010000:00010000:3.0:1787830062.070539:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830062.070553:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8d10 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.070562:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8d10 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.070624:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8d02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c32 expref: 8 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.070641:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8d17 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c32 expref: 7 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.070647:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e9b478cc400) 00010000:00010000:3.0:1787830062.070650:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787830062.070652:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b40030400, rc 0) 00000100:00100000:3.0:1787830062.070720:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:612b807d-ada2-4e97-9e6f-ce18d749b2d4+7:14460:x1874675275778944:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 5545us (5813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830062.070729:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 22 00000100:00100000:3.0:1787830062.081265:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830062.083409:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275779200 00000100:00100000:2.0:1787830062.083428:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275779200 00000100:00100000:2.0:1787830062.083527:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 23 00000100:00100000:2.0:1787830062.083541:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:612b807d-ada2-4e97-9e6f-ce18d749b2d4+7:14460:x1874675275779200:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:2.0:1787830062.083567:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830062.083595:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bc000/0xc03b4d103c0d8d1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8c39 expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787830062.083774:0:14328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787830062.083926:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bc000/0xc03b4d103c0d8d1e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c39 expref: 9 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830062.083944:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b45193f00) 00010000:00010000:2.0:1787830062.083948:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787830062.083953:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bc000/0xc03b4d103c0d8d1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c39 expref: 9 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830062.083970:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9a437bc000, rc 0) 00000100:00100000:2.0:1787830062.084131:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:612b807d-ada2-4e97-9e6f-ce18d749b2d4+8:14460:x1874675275779200:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 593us (2881us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1787830062.084140:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 23 00000100:00100000:1.0:1787830062.089427:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830062.089586:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275779456 00000100:00100000:3.0:1787830062.089598:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275779456 00000100:00100000:3.0:1787830062.089681:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 24 00000100:00100000:3.0:1787830062.089693:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52385e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:612b807d-ada2-4e97-9e6f-ce18d749b2d4+8:14460:x1874675275779456:12345-192.168.201.51@tcp:36:lfs.0 00010000:00010000:3.0:1787830062.089791:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830062.089951:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8d17 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c32 expref: 8 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.093754:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e9b478cc400) 00010000:00010000:3.0:1787830062.093782:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787830062.093851:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8d2c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.093872:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8d2c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.093888:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8d2c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787830062.094434:0:14330:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e8ad190 reply state 00000000e0258cd9 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8d2c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830062.094446:0:14330:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787830062.094463:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1787830062.094595:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52385e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:612b807d-ada2-4e97-9e6f-ce18d749b2d4+9:14460:x1874675275779456:12345-192.168.201.51@tcp:36:lfs.0 Request processed in 4899us (5179us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787830062.094606:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 24 00010000:00010000:0.0:1787830062.097676:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8d2c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.097700:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8d2c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.097710:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8d2c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.097717:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40030e00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787830062.097722:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8d2c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.097732:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8d2c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.097780:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e9b478ccb00) 00010000:00010000:0.0:1787830062.097784:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1787830062.097791:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8d2c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.097798:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8d2c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830062.097872:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830062.097989:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275779712 00000100:00100000:0.0:1787830062.098002:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275779712 00000100:00100000:0.0:1787830062.098107:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 2 00000100:00100000:0.0:1787830062.098119:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52384f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:612b807d-ada2-4e97-9e6f-ce18d749b2d4+8:14460:x1874675275779712:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:0.0:1787830062.098469:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52384f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:612b807d-ada2-4e97-9e6f-ce18d749b2d4+9:14460:x1874675275779712:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 351us (601us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787830062.098477:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 2 00000100:00100000:1.0:1787830062.117927:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830062.118118:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275779968 00000100:00100000:0.0:1787830062.118130:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275779968 00000100:00100000:0.0:1787830062.118210:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 25 00000100:00100000:0.0:1787830062.118221:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b523861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:612b807d-ada2-4e97-9e6f-ce18d749b2d4+9:14460:x1874675275779968:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:0.0:1787830062.118255:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830062.118295:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07200/0xc03b4d103c0d8d33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8c40 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.118391:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8d3a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.118410:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8d3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.118441:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8d3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.118459:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06000/0xc03b4d103c0d8d41 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.118466:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06000/0xc03b4d103c0d8d41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.118473:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06000/0xc03b4d103c0d8d41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830062.118647:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787830062.118771:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8d3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.118779:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8d3a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.118787:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8d3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.118793:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b6fd07800 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787830062.118798:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8d3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.118806:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8d3a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.118821:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b45193f00) 00010000:00010000:0.0:1787830062.118824:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830062.118838:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8d3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.118844:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8d3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.118861:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06000/0xc03b4d103c0d8d41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.118868:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06000/0xc03b4d103c0d8d41 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.118874:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06000/0xc03b4d103c0d8d41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.118880:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b6fd06000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787830062.118883:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06000/0xc03b4d103c0d8d41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.118888:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06000/0xc03b4d103c0d8d41 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.118897:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e9b478eaa00) 00010000:00010000:0.0:1787830062.118899:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830062.118902:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06000/0xc03b4d103c0d8d41 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.118908:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06000/0xc03b4d103c0d8d41 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.118956:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07200/0xc03b4d103c0d8d33 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c40 expref: 11 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.119933:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b45193f00) 00010000:00010000:0.0:1787830062.119937:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787830062.119946:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07200/0xc03b4d103c0d8d33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c40 expref: 11 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.119963:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b6fd07200, rc 0) 00000100:00100000:0.0:1787830062.120962:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b523861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:612b807d-ada2-4e97-9e6f-ce18d749b2d4+10:14460:x1874675275779968:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 2736us (3045us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1787830062.120981:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 25 00000100:00100000:0.0:1787830062.132143:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830062.132619:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275780096 00000100:00100000:3.0:1787830062.132634:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275780096 00000100:00100000:3.0:1787830062.132717:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 26 00000100:00100000:3.0:1787830062.132730:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:612b807d-ada2-4e97-9e6f-ce18d749b2d4+10:14460:x1874675275780096:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:3.0:1787830062.132763:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830062.132793:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8d4f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8c47 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.133327:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8d56 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.133347:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8d56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.133371:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8d56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830062.133441:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787830062.133445:0:14330:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787830062.133472:0:14330:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8d56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.133507:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8d4f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c47 expref: 12 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.133529:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8d56 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c47 expref: 11 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.133539:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e9b478cc400) 00010000:00010000:3.0:1787830062.133541:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787830062.133545:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b40030400, rc 0) 00000100:00100000:3.0:1787830062.133634:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:612b807d-ada2-4e97-9e6f-ce18d749b2d4+11:14460:x1874675275780096:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 906us (1504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830062.133644:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 26 00000100:00100000:1.0:1787830062.159835:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830062.160240:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275780224 00000100:00100000:0.0:1787830062.160256:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275780224 00000100:00100000:0.0:1787830062.160356:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 3 00000100:00100000:0.0:1787830062.160369:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52386580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:612b807d-ada2-4e97-9e6f-ce18d749b2d4+11:14460:x1874675275780224:12345-192.168.201.51@tcp:37:lfs.0 00000100:00100000:0.0:1787830062.168727:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52386580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:612b807d-ada2-4e97-9e6f-ce18d749b2d4+11:14460:x1874675275780224:12345-192.168.201.51@tcp:37:lfs.0 Request processed in 8344us (8890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830062.168746:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 3 00000100:00100000:3.0:1787830062.171620:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830062.171731:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275780480 00000100:00100000:1.0:1787830062.171743:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275780480 00000100:00100000:1.0:1787830062.171808:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 4 00000100:00100000:1.0:1787830062.171829:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7695c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:612b807d-ada2-4e97-9e6f-ce18d749b2d4+11:14460:x1874675275780480:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:1.0:1787830062.172206:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7695c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:612b807d-ada2-4e97-9e6f-ce18d749b2d4+12:14460:x1874675275780480:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 386us (600us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787830062.172214:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 4 00000100:00100000:1.0:1787830062.243799:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830062.244237:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275780608 00000100:00100000:0.0:1787830062.244251:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275780608 00000100:00100000:0.0:1787830062.244345:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 27 00000100:00100000:0.0:1787830062.244358:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52384f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+10:14466:x1874675275780608:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:0.0:1787830062.244389:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830062.244419:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07200/0xc03b4d103c0d8d5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8c4e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.244541:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06000/0xc03b4d103c0d8d64 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.244561:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06000/0xc03b4d103c0d8d64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.244574:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06000/0xc03b4d103c0d8d64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.244591:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8d6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.244599:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8d6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.244606:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8d6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.244758:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06e00/0xc03b4d103c0d8d72 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.244768:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06e00/0xc03b4d103c0d8d72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.244776:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06e00/0xc03b4d103c0d8d72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830062.244892:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787830062.244897:0:14329:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787830062.245131:0:14329:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06e00/0xc03b4d103c0d8d72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.245159:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06000/0xc03b4d103c0d8d64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.245167:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06000/0xc03b4d103c0d8d64 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.245175:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06000/0xc03b4d103c0d8d64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.245181:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b6fd06000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787830062.245185:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06000/0xc03b4d103c0d8d64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.245193:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06000/0xc03b4d103c0d8d64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.245208:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b45193f00) 00010000:00010000:0.0:1787830062.245212:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830062.245217:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06000/0xc03b4d103c0d8d64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.245224:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06000/0xc03b4d103c0d8d64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.245240:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8d6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.245247:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8d6b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.245251:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8d6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.245263:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b6fd07800 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787830062.245266:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8d6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.245272:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8d6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.245291:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e9b478eaa00) 00010000:00010000:0.0:1787830062.245295:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830062.245298:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8d6b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.245304:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8d6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.245344:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07200/0xc03b4d103c0d8d5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c4e expref: 12 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.247712:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06e00/0xc03b4d103c0d8d72 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c4e expref: 11 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.247728:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e9b478cc400) 00010000:00010000:0.0:1787830062.247731:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787830062.247736:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b6fd06e00, rc 0) 00000100:00100000:0.0:1787830062.247861:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52384f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+11:14466:x1874675275780608:12345-192.168.201.51@tcp:101:bash.0 Request processed in 3505us (4078us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830062.247872:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 27 00000100:00100000:2.0:1787830062.260534:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830062.260984:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275780864 00000100:00100000:3.0:1787830062.261049:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275780864 00000100:00100000:3.0:1787830062.261129:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 28 00000100:00100000:3.0:1787830062.261142:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f383840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bad48885-a767-440f-85b6-3e1bee305ba5+11:14466:x1874675275780864:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:3.0:1787830062.261173:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830062.261201:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8d79 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8c55 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.261569:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8d80 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.261589:0:14330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8d56 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c47 expref: 11 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.261600:0:14330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8d80 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.261649:0:14330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8d56 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8c47 expref: 11 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.261667:0:14330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8d56 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8c47 expref: 11 pid: 14330 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830062.261683:0:14330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fb62580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14330:1874675284156800:192.168.201.51@tcp:104: 00000100:00100000:3.0:1787830062.261917:0:14330:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b42cfa300 going to sleep for 11 seconds 00000100:00100000:3.0:1787830062.276767:0:14330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fb62580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14330:1874675284156800:192.168.201.51@tcp:104: 00010000:00010000:3.0:1787830062.276811:0:14330:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8d80 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830062.277682:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830062.277810:0:16449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275780992 00000100:00100000:0.0:1787830062.277834:0:16449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275780992 00010000:00010000:0.0:1787830062.277898:0:16449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8d56 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8c47 expref: 12 pid: 14330 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830062.277949:0:16449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 10 00000100:00100000:0.0:1787830062.277961:0:16449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f382940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:612b807d-ada2-4e97-9e6f-ce18d749b2d4+12:2363:x1874675275780992:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787830062.277985:0:16449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830062.277992:0:16449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8d56 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8c47 expref: 12 pid: 14330 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.278009:0:16449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8d56 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8c47 expref: 12 pid: 14330 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.278079:0:16449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8d56 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8c47 expref: 12 pid: 14330 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.278101:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e9b478cc400) 00010000:00010000:0.0:1787830062.278106:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8d80 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.278116:0:16449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8d80 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.278125:0:16449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8d80 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.278160:0:16449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830062.278229:0:16449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f382940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:612b807d-ada2-4e97-9e6f-ce18d749b2d4+11:2363:x1874675275780992:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 270us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830062.278248:0:16449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 10 00010000:00010000:3.0:1787830062.278453:0:14330:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8d80 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.278463:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8d80 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.278495:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8d87 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.278508:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8d87 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.278516:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8d87 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.279507:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031800/0xc03b4d103c0d8d8e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.279523:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031800/0xc03b4d103c0d8d8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.279533:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031800/0xc03b4d103c0d8d8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830062.279546:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787830062.279585:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8d80 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.279593:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8d80 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.279600:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8d80 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.279615:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40031e00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787830062.279620:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8d80 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.279629:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8d80 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.279643:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e9b478cc400) 00010000:00010000:3.0:1787830062.279646:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830062.279651:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8d80 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.279658:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8d80 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787830062.279673:0:14330:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a736cc23 reply state 000000000332e14e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8d87 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830062.279684:0:14330:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787830062.279732:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8d79 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c55 expref: 14 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.279749:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031800/0xc03b4d103c0d8d8e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c55 expref: 13 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.279758:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:3.0:1787830062.279761:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1787830062.279763:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b40031800, rc 0) 00000100:00100000:3.0:1787830062.279832:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f383840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bad48885-a767-440f-85b6-3e1bee305ba5+14:14466:x1874675275780864:12345-192.168.201.51@tcp:101:bash.0 Request processed in 18693us (19314us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787830062.279849:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 28 00010000:00010000:3.0:1787830062.288209:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8d87 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.288234:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8d87 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.288243:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8d87 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.288251:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40031a00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787830062.288256:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8d87 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.288266:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8d87 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.288309:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9e9b478cc200) 00010000:00010000:3.0:1787830062.288313:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830062.288319:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8d87 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.288327:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8d87 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830062.306841:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830062.306970:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275781120 00000100:00100000:0.0:1787830062.306985:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275781120 00000100:00100000:0.0:1787830062.307118:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 29 00000100:00100000:0.0:1787830062.307130:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f380780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+13:14466:x1874675275781120:12345-192.168.201.51@tcp:101:bash.0 00010000:00010000:0.0:1787830062.307165:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830062.307192:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07200/0xc03b4d103c0d8d9c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8c5c expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.307302:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8da3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.307320:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8da3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.307335:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8da3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830062.307390:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787830062.307395:0:14329:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787830062.307421:0:14329:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8da3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.307433:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8da3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.307467:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07200/0xc03b4d103c0d8d9c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c5c expref: 15 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.307494:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8da3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c5c expref: 14 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.307524:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:0.0:1787830062.307527:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787830062.307531:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b6fd07800, rc 0) 00000100:00100000:0.0:1787830062.307612:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f380780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+14:14466:x1874675275781120:12345-192.168.201.51@tcp:101:bash.0 Request processed in 484us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830062.307620:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 29 00000100:00100000:1.0:1787830062.318152:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830062.318275:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275781376 00000100:00100000:2.0:1787830062.318311:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275781376 00000100:00100000:2.0:1787830062.318379:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 5 00000100:00100000:2.0:1787830062.318391:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52386580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bad48885-a767-440f-85b6-3e1bee305ba5+14:14466:x1874675275781376:12345-192.168.201.51@tcp:35:bash.0 00000100:00100000:2.0:1787830062.318883:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52386580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bad48885-a767-440f-85b6-3e1bee305ba5+15:14466:x1874675275781376:12345-192.168.201.51@tcp:35:bash.0 Request processed in 493us (746us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787830062.318894:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 5 00000100:00100000:3.0:1787830062.434391:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787830062.434416:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f382580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284156928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787830062.434494:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830062.434628:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284156928 00000100:00100000:2.0:1787830062.434638:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284156928 00000100:00100000:2.0:1787830062.434732:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787830062.434741:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb62580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284156928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787830062.434776:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787830062.434840:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb62580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284156928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830062.434848:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787830062.434898:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f382580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284156928:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787830062.435099:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787830062.436093:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3281:1874675284157056:0@lo:400:kworker.0 00000100:00100000:2.0:1787830062.436143:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830062.436227:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284157056 00000100:00100000:3.0:1787830062.436243:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284157056 00000100:00100000:3.0:1787830062.436297:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787830062.436305:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6f5fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:3281:x1874675284157056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830062.436441:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284157440:0@lo:400:kworker.0 00000100:00100000:1.0:1787830062.436475:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830062.436539:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284157184:0@lo:400:kworker.0 00000100:00100000:1.0:1787830062.436569:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830062.436591:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787830062.436596:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284157312:0@lo:400:kworker.0 00000100:00100000:1.0:1787830062.436618:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830062.436642:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284157184 00000100:00100000:1.0:1787830062.436646:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284157184 00000100:00100000:1.0:1787830062.436683:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787830062.436691:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52386d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284157184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830062.436731:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52386d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284157184:12345-0@lo:400:kworker.0 Request processed in 40us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830062.436738:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787830062.436779:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284157184:0@lo:400:kworker.0 00000100:00080000:1.0:1787830062.436797:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787830062.436837:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284157440 00000100:00100000:1.0:1787830062.436841:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284157440 00000100:00080000:1.0:1787830062.436855:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787830062.436876:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284157312 00000100:00100000:1.0:1787830062.436879:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284157312 00000100:00100000:1.0:1787830062.436893:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787830062.436899:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52384b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284157440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830062.436934:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52384b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874675284157440:12345-0@lo:400:kworker.0 Request processed in 35us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830062.436941:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787830062.436963:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1874675284157440:0@lo:400:kworker.0 00000100:00100000:1.0:1787830062.436981:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787830062.436987:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b523870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284157312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830062.437058:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b523870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284157312:12345-0@lo:400:kworker.0 Request processed in 71us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830062.437065:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787830062.437087:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284157312:0@lo:400:kworker.0 00000100:00100000:3.0:1787830062.443777:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6f5fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:3281:x1874675284157056:12345-0@lo:400:kworker.0 Request processed in 7460us (7620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830062.444222:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787830062.444384:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3281:1874675284157056:0@lo:400:kworker.0 00000100:00100000:1.0:1787830062.444608:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787830062.444623:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1874675284157568:0@lo:400:kworker.0 00000100:00100000:1.0:1787830062.444681:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830062.446295:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284157568 00000100:00100000:0.0:1787830062.446306:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284157568 00000100:00100000:0.0:1787830062.446396:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787830062.446406:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b523843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874675284157568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830062.446488:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b523843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874675284157568:12345-0@lo:400:kworker.0 Request processed in 84us (1806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830062.446496:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1787830062.446739:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787830062.447119:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1874675284157568:0@lo:400:kworker.0 00000100:00100000:1.0:1787830062.479213:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830062.479543:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275781632 00000100:00100000:3.0:1787830062.479553:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275781632 00000100:00100000:3.0:1787830062.479616:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 30 00000100:00100000:3.0:1787830062.479626:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52385680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bad48885-a767-440f-85b6-3e1bee305ba5+15:14476:x1874675275781632:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:3.0:1787830062.479660:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830062.479683:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8daa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8c63 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830062.479829:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787830062.480422:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8daa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c63 expref: 17 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.480438:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9b45193f00) 00010000:00010000:3.0:1787830062.480441:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787830062.480446:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8daa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c63 expref: 17 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.480462:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b40031a00, rc 0) 00000100:00100000:3.0:1787830062.480580:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52385680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bad48885-a767-440f-85b6-3e1bee305ba5+16:14476:x1874675275781632:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 954us (1375us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1787830062.480587:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 30 00000100:00100000:1.0:1787830062.489405:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830062.489503:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275781888 00000100:00100000:2.0:1787830062.489514:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275781888 00000100:00100000:2.0:1787830062.489580:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 6 00000100:00100000:2.0:1787830062.489590:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52384780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bad48885-a767-440f-85b6-3e1bee305ba5+16:14476:x1874675275781888:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:2.0:1787830062.490356:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52384780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bad48885-a767-440f-85b6-3e1bee305ba5+17:14476:x1874675275781888:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 764us (957us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787830062.490364:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 6 00000040:00080000:0.0:1787830062.499053:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787830062.549405:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830062.549701:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275782144 00000100:00100000:3.0:1787830062.549711:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275782144 00000100:00100000:3.0:1787830062.549810:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 31 00000100:00100000:3.0:1787830062.549829:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52387c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+17:14479:x1874675275782144:12345-192.168.201.51@tcp:101:lfs.0 00010000:00010000:3.0:1787830062.549854:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830062.549882:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8db8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8c6a expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.549987:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8dbf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.550002:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8dbf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.550014:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8dbf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830062.550049:0:14328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787830062.550167:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8db8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c6a expref: 20 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.550199:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8dbf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c6a expref: 19 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.550209:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:3.0:1787830062.550212:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787830062.550215:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b40031200, rc 0) 00000100:00100000:3.0:1787830062.550298:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52387c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+19:14479:x1874675275782144:12345-192.168.201.51@tcp:101:lfs.0 Request processed in 471us (2482us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1787830062.550323:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 31 00000100:00100000:1.0:1787830062.554905:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830062.554951:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830062.555045:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275782272 00000100:00100000:0.0:1787830062.555055:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275782272 00000100:00100000:0.0:1787830062.555106:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 32 00000100:00100000:0.0:1787830062.555117:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+19:14479:x1874675275782272:12345-192.168.201.51@tcp:54:lfs.0 00010000:00010000:0.0:1787830062.555594:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07200/0xc03b4d103c0d8dcd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.555614:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07200/0xc03b4d103c0d8dcd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.555627:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07200/0xc03b4d103c0d8dcd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.555675:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07200/0xc03b4d103c0d8dcd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.555682:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07200/0xc03b4d103c0d8dcd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.555689:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07200/0xc03b4d103c0d8dcd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.555696:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b6fd07200 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787830062.555700:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07200/0xc03b4d103c0d8dcd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.555708:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07200/0xc03b4d103c0d8dcd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.555720:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:0.0:1787830062.555723:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787830062.555727:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07200/0xc03b4d103c0d8dcd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.555734:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07200/0xc03b4d103c0d8dcd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830062.555820:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+19:14479:x1874675275782272:12345-192.168.201.51@tcp:54:lfs.0 Request processed in 695us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830062.555830:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 32 00000100:00100000:3.0:1787830062.557384:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275782400 00000100:00100000:3.0:1787830062.557394:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275782400 00000100:00100000:2.0:1787830062.557628:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 0 00000100:00100000:2.0:1787830062.557638:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52385a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bad48885-a767-440f-85b6-3e1bee305ba5+19:2362:x1874675275782400:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830062.557654:0:14313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830062.557675:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8dbf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c6a expref: 19 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830062.557692:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:2.0:1787830062.557709:0:14313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830062.557762:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52385a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bad48885-a767-440f-85b6-3e1bee305ba5+18:2362:x1874675275782400:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 125us (2809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830062.557770:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 0 00000100:00100000:1.0:1787830062.560460:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830062.560595:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275782656 00000100:00100000:0.0:1787830062.560604:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275782656 00000100:00100000:0.0:1787830062.560657:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 7 00000100:00100000:0.0:1787830062.560681:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b523852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bad48885-a767-440f-85b6-3e1bee305ba5+18:14479:x1874675275782656:12345-192.168.201.51@tcp:35:lfs.0 00000100:00100000:0.0:1787830062.560927:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b523852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bad48885-a767-440f-85b6-3e1bee305ba5+19:14479:x1874675275782656:12345-192.168.201.51@tcp:35:lfs.0 Request processed in 248us (473us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787830062.560935:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 7 00010000:00010000:0.0:1787830062.882631:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830062.921305:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830062.921550:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275782912 00000100:00100000:3.0:1787830062.921561:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275782912 00000100:00100000:3.0:1787830062.921628:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 33 00000100:00100000:3.0:1787830062.921639:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52386940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+19:14510:x1874675275782912:12345-192.168.201.51@tcp:101:cat.0 00010000:00010000:3.0:1787830062.921667:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830062.921691:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8dd4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8c71 expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.921803:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8ddb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.921819:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8ddb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.921831:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8ddb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830062.921842:0:14328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787830062.921999:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8dd4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c71 expref: 22 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.922079:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8ddb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c71 expref: 21 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830062.922088:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:3.0:1787830062.922104:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787830062.922108:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b40031e00, rc 0) 00000100:00100000:3.0:1787830062.922320:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52386940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+21:14510:x1874675275782912:12345-192.168.201.51@tcp:101:cat.0 Request processed in 682us (1057us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1787830062.922328:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 33 00000100:00100000:1.0:1787830062.938066:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830062.938183:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830062.938504:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275783296 00000100:00100000:2.0:1787830062.938514:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275783296 00000100:00100000:2.0:1787830062.938578:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 8 00000100:00100000:2.0:1787830062.938590:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bad48885-a767-440f-85b6-3e1bee305ba5+21:14510:x1874675275783296:12345-192.168.201.51@tcp:35:cat.0 00000100:00100000:2.0:1787830062.938962:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bad48885-a767-440f-85b6-3e1bee305ba5+22:14510:x1874675275783296:12345-192.168.201.51@tcp:35:cat.0 Request processed in 373us (777us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1787830062.938970:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 8 00000100:00100000:0.0:1787830062.939469:0:16449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275783040 00000100:00100000:0.0:1787830062.939476:0:16449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275783040 00000100:00100000:0.0:1787830062.939529:0:16449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 1 00000100:00100000:0.0:1787830062.939537:0:16449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5455a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bad48885-a767-440f-85b6-3e1bee305ba5+22:2362:x1874675275783040:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787830062.939550:0:16449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830062.939577:0:16449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031e00/0xc03b4d103c0d8ddb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c71 expref: 22 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830062.939598:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:0.0:1787830062.939603:0:16449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830062.939640:0:16449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5455a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bad48885-a767-440f-85b6-3e1bee305ba5+21:2362:x1874675275783040:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 104us (1587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830062.939646:0:16449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 1 00000100:00100000:1.0:1787830063.001146:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830063.002004:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275783552 00000100:00100000:0.0:1787830063.002066:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275783552 00000100:00100000:0.0:1787830063.002145:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 34 00000100:00100000:0.0:1787830063.002158:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+21:14516:x1874675275783552:12345-192.168.201.51@tcp:101:dd.0 00010000:00010000:0.0:1787830063.002194:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830063.002221:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06000/0xc03b4d103c0d8de9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8c78 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.004976:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd800/0xc03b4d103c0d8df0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.005004:0:14329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031800/0xc03b4d103c0d8d8e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c55 expref: 22 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.005050:0:14329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8da3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c5c expref: 22 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.005061:0:14329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd800/0xc03b4d103c0d8df0 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.005106:0:14329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8da3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8c5c expref: 22 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.005125:0:14329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8da3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8c5c expref: 22 pid: 14329 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830063.005161:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f382580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14329:1874675284157696:192.168.201.51@tcp:104: 00010000:00010000:2.0:1787830063.007702:0:14329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031800/0xc03b4d103c0d8d8e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8c55 expref: 22 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.007723:0:14329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031800/0xc03b4d103c0d8d8e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8c55 expref: 22 pid: 14330 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830063.007740:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f380f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14329:1874675284157824:192.168.201.51@tcp:104: 00000100:00100000:2.0:1787830063.007885:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47ab6780 going to sleep for 11 seconds 00000100:00100000:2.0:1787830063.011608:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830063.011650:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830063.011680:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275783680 00000100:00100000:2.0:1787830063.011688:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275783680 00010000:00010000:2.0:1787830063.011730:0:14314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8da3 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8c5c expref: 23 pid: 14329 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830063.011761:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275783808 00000100:00100000:2.0:1787830063.011765:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275783808 00010000:00010000:2.0:1787830063.011782:0:14314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031800/0xc03b4d103c0d8d8e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8c55 expref: 24 pid: 14330 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830063.011803:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 11 00000100:00100000:2.0:1787830063.011814:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7a7a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bad48885-a767-440f-85b6-3e1bee305ba5+24:2362:x1874675275783680:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830063.011830:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830063.011836:0:14314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8da3 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8c5c expref: 24 pid: 14329 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.011862:0:14314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8da3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8c5c expref: 24 pid: 14329 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.011885:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:2.0:1787830063.011891:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd800/0xc03b4d103c0d8df0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.011899:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd800/0xc03b4d103c0d8df0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.011905:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830063.012356:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 12 00000100:00100000:2.0:1787830063.012365:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f381a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bad48885-a767-440f-85b6-3e1bee305ba5+24:2362:x1874675275783808:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830063.012374:0:14313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830063.012380:0:14313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031800/0xc03b4d103c0d8d8e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8c55 expref: 24 pid: 14330 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.012391:0:14313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031800/0xc03b4d103c0d8d8e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8c55 expref: 24 pid: 14330 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.012403:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:2.0:1787830063.012427:0:14313:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd800/0xc03b4d103c0d8df0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.012436:0:14313:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd800/0xc03b4d103c0d8df0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.012454:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd800/0xc03b4d103c0d8df0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.012560:0:14313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830063.012716:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f381a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bad48885-a767-440f-85b6-3e1bee305ba5+24:2362:x1874675275783808:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 350us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830063.012725:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 12 00000100:00100000:2.0:1787830063.012764:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7a7a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bad48885-a767-440f-85b6-3e1bee305ba5+23:2362:x1874675275783680:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 952us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830063.012771:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 11 00010000:00010000:2.0:1787830063.012937:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07800/0xc03b4d103c0d8da3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8c5c expref: 22 pid: 14329 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830063.012956:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f382580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14329:1874675284157696:192.168.201.51@tcp:104: 00010000:00010000:2.0:1787830063.012968:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031800/0xc03b4d103c0d8d8e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8c55 expref: 21 pid: 14330 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830063.012978:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f380f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14329:1874675284157824:192.168.201.51@tcp:104: 00010000:00010000:2.0:1787830063.012998:0:14329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd800/0xc03b4d103c0d8df0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.013007:0:14329:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd800/0xc03b4d103c0d8df0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.013013:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd800/0xc03b4d103c0d8df0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787830063.013082:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787830063.013333:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06000/0xc03b4d103c0d8de9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c78 expref: 22 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.013348:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd800/0xc03b4d103c0d8df0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c78 expref: 21 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.013356:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:2.0:1787830063.013359:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787830063.013362:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9a437bd800, rc 0) 00000100:00100000:2.0:1787830063.013404:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+21:14516:x1874675275783552:12345-192.168.201.51@tcp:101:dd.0 Request processed in 11251us (12270us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1787830063.013411:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 34 00000100:00100000:3.0:1787830063.016870:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830063.017093:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275784064 00000100:00100000:0.0:1787830063.017109:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275784064 00000100:00100000:0.0:1787830063.017184:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 35 00000100:00100000:0.0:1787830063.017196:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bad48885-a767-440f-85b6-3e1bee305ba5+21:14516:x1874675275784064:12345-192.168.201.51@tcp:36:dd.0 00010000:00010000:0.0:1787830063.017531:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8dfe lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.017549:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8dfe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.017561:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8dfe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787830063.017612:0:14330:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787830063.017643:0:14330:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb2d18f1 reply state 00000000e7bb3dd7 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8dfe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830063.017651:0:14330:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787830063.017753:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bad48885-a767-440f-85b6-3e1bee305ba5+24:14516:x1874675275784064:12345-192.168.201.51@tcp:36:dd.0 Request processed in 557us (899us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787830063.017761:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 35 00000020:00080000:0.0:1787830063.017767:0:14330:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787830063.019375:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8dfe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.019396:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8dfe lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.019405:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8dfe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.019412:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b6fd07a00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787830063.019417:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8dfe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.019425:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8dfe lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.019474:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:2.0:1787830063.019478:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830063.019550:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8dfe lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.019559:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07a00/0xc03b4d103c0d8dfe lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830063.021716:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000001:00080000:0.0:1787830063.022365:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934605 is committed 00000001:00080000:0.0:1787830063.022382:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:0.0:1787830063.022398:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:0.0:1787830063.022405:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934607 is committed 00000100:00100000:3.0:1787830063.022622:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275784192 00000100:00100000:3.0:1787830063.022632:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275784192 00000100:00100000:3.0:1787830063.022695:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 36 00000100:00100000:3.0:1787830063.022705:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+13:14516:x1874675275784192:12345-192.168.201.51@tcp:101:dd.0 00010000:00010000:3.0:1787830063.022796:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830063.022815:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8e05 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8c7f expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.022872:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8e05 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c7f expref: 14 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.022886:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8e05 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c7f expref: 14 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.022904:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:3.0:1787830063.022907:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787830063.022910:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b40031200, rc 0) 00000100:00100000:3.0:1787830063.022975:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+14:14516:x1874675275784192:12345-192.168.201.51@tcp:101:dd.0 Request processed in 271us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830063.022982:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 36 00000100:00100000:1.0:1787830063.038672:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830063.038979:0:16449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275784448 00000100:00100000:2.0:1787830063.038992:0:16449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275784448 00000100:00100000:2.0:1787830063.039233:0:16449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 2 00000100:00100000:2.0:1787830063.039246:0:16449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bad48885-a767-440f-85b6-3e1bee305ba5+14:14516:x1874675275784448:12345-192.168.201.51@tcp:103:dd.0 00010000:00010000:2.0:1787830063.039277:0:16449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830063.039312:0:16449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8e05 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c7f expref: 14 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.039340:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:2.0:1787830063.039346:0:16449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830063.039418:0:16449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bad48885-a767-440f-85b6-3e1bee305ba5+13:14516:x1874675275784448:12345-192.168.201.51@tcp:103:dd.0 Request processed in 175us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830063.039426:0:16449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 2 00000100:00100000:2.0:1787830063.041790:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830063.041878:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275784576 00000100:00100000:3.0:1787830063.041905:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275784576 00000100:00100000:3.0:1787830063.041971:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 37 00000100:00100000:3.0:1787830063.041982:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f380f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+13:14516:x1874675275784576:12345-192.168.201.51@tcp:58:dd.0 00010000:00010000:3.0:1787830063.042136:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8e0c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.042157:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8e0c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.042182:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8e0c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787830063.042942:0:14328:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787830063.043143:0:14328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1787830063.043220:0:14328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1787830063.043360:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f380f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+13:14516:x1874675275784576:12345-192.168.201.51@tcp:58:dd.0 Request processed in 1377us (1582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830063.043371:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 37 00000100:00100000:1.0:1787830063.045770:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830063.045880:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275784704 00000100:00100000:0.0:1787830063.045889:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275784704 00000100:00100000:0.0:1787830063.045961:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 38 00000100:00100000:0.0:1787830063.045971:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bad48885-a767-440f-85b6-3e1bee305ba5+13:14516:x1874675275784704:12345-192.168.201.51@tcp:101:dd.0 00010000:00010000:0.0:1787830063.045993:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830063.046048:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8e13 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8c86 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.046111:0:14330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8e0c lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.046123:0:14330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8e13 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c86 expref: 14 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.046144:0:14330:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8e0c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.046158:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8e13 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c86 expref: 14 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.046182:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:0.0:1787830063.046185:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787830063.046189:0:14330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8e13 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c86 expref: 14 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.046198:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b6fd07600, rc 0) 00000100:00100000:0.0:1787830063.046255:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bad48885-a767-440f-85b6-3e1bee305ba5+14:14516:x1874675275784704:12345-192.168.201.51@tcp:101:dd.0 Request processed in 283us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830063.046262:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 38 00000040:00080000:0.0:1787830063.522303:0:14362:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787830063.522327:0:14362:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787830063.522372:0:14362:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787830063.522379:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787830063.522507:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955e940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14362:1874675284157952:192.168.201.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787830063.522611:0:14362:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4f8dc600 going to sleep for 11 seconds 00000100:00100000:0.0:1787830063.525768:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955e940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14362:1874675284157952:192.168.201.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787830063.526438:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830063.526754:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275784832 00000100:00100000:0.0:1787830063.526763:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275784832 00000100:00100000:0.0:1787830063.526829:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 0 00000100:00100000:0.0:1787830063.526839:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f382580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bad48885-a767-440f-85b6-3e1bee305ba5+14:14517:x1874675275784832:12345-192.168.201.51@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787830063.526923:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f382580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bad48885-a767-440f-85b6-3e1bee305ba5+14:14517:x1874675275784832:12345-192.168.201.51@tcp:900:lhsmtool_posix.0 Request processed in 85us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830063.526931:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 0 00000100:00100000:1.0:1787830063.533498:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830063.533824:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275784960 00000100:00100000:3.0:1787830063.533836:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275784960 00000100:00100000:3.0:1787830063.533921:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 39 00000100:00100000:3.0:1787830063.533932:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+14:14517:x1874675275784960:12345-192.168.201.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787830063.533965:0:14328:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787830063.534169:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+14:14517:x1874675275784960:12345-192.168.201.51@tcp:53:lhsmtool_posix.0 Request processed in 238us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830063.534177:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 39 00000100:00100000:1.0:1787830063.543533:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830063.543614:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275785088 00000100:00100000:0.0:1787830063.543623:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275785088 00000100:00100000:0.0:1787830063.543688:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 40 00000100:00100000:0.0:1787830063.543697:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bad48885-a767-440f-85b6-3e1bee305ba5+14:14517:x1874675275785088:12345-192.168.201.51@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787830063.543775:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06200/0xc03b4d103c0d8e1a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.543794:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06200/0xc03b4d103c0d8e1a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.543815:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06200/0xc03b4d103c0d8e1a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.545238:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07000/0xc03b4d103c0d8e21 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.545285:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07000/0xc03b4d103c0d8e21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.545295:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07000/0xc03b4d103c0d8e21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.545328:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06600/0xc03b4d103c0d8e28 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.545337:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06600/0xc03b4d103c0d8e28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.545344:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06600/0xc03b4d103c0d8e28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830063.545389:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787830063.545394:0:14330:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787830063.545408:0:14330:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06600/0xc03b4d103c0d8e28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.545421:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06200/0xc03b4d103c0d8e1a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.545427:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06200/0xc03b4d103c0d8e1a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.545434:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06200/0xc03b4d103c0d8e1a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.545441:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b6fd06200 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787830063.545445:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06200/0xc03b4d103c0d8e1a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.545459:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06200/0xc03b4d103c0d8e1a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.545472:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e9b478cc100) 00010000:00010000:0.0:1787830063.545475:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830063.545480:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06200/0xc03b4d103c0d8e1a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.545486:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06200/0xc03b4d103c0d8e1a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.545502:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07000/0xc03b4d103c0d8e21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.545507:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07000/0xc03b4d103c0d8e21 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.545513:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07000/0xc03b4d103c0d8e21 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.545518:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b6fd07000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787830063.545520:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07000/0xc03b4d103c0d8e21 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.545526:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07000/0xc03b4d103c0d8e21 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.545532:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9e9b478eaa00) 00010000:00010000:0.0:1787830063.545534:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830063.545537:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07000/0xc03b4d103c0d8e21 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.545552:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07000/0xc03b4d103c0d8e21 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.545569:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06600/0xc03b4d103c0d8e28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.545575:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06600/0xc03b4d103c0d8e28 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.545581:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06600/0xc03b4d103c0d8e28 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.545586:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b6fd06600 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787830063.545589:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06600/0xc03b4d103c0d8e28 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.545595:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06600/0xc03b4d103c0d8e28 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.545603:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:0.0:1787830063.545605:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830063.545608:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06600/0xc03b4d103c0d8e28 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.545614:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06600/0xc03b4d103c0d8e28 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830063.545717:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bad48885-a767-440f-85b6-3e1bee305ba5+14:14517:x1874675275785088:12345-192.168.201.51@tcp:34:lhsmtool_posix.0 Request processed in 2017us (2189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830063.545727:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 40 00000100:00100000:1.0:1787830063.549269:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830063.549461:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275785344 00000100:00100000:3.0:1787830063.549473:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275785344 00000100:00100000:3.0:1787830063.549545:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 41 00000100:00100000:3.0:1787830063.549574:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+14:14517:x1874675275785344:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787830063.549595:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830063.549617:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8e2f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8c8d expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.549718:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8e36 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.549735:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8e36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.549747:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8e36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830063.549757:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787830063.550108:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8e36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.550117:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8e36 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.550124:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8e36 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.550130:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40030e00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787830063.550134:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8e36 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.550142:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8e36 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.550154:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:3.0:1787830063.550163:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787830063.550170:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8e36 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.550176:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8e36 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.550226:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8e2f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c8d expref: 16 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.550237:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e9b478cc100) 00010000:00010000:3.0:1787830063.550239:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787830063.550243:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8e2f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c8d expref: 16 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.550251:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b40030400, rc 0) 00000100:00100000:3.0:1787830063.550372:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+15:14517:x1874675275785344:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 800us (1120us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1787830063.550380:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 41 00000100:00100000:1.0:1787830063.569398:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830063.572323:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275785472 00000100:00100000:3.0:1787830063.572340:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275785472 00000100:00100000:2.0:1787830063.572553:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 42 00000100:00100000:2.0:1787830063.572566:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+15:14517:x1874675275785472:12345-192.168.201.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787830063.572610:0:14328:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787830063.572756:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+15:14517:x1874675275785472:12345-192.168.201.51@tcp:53:lhsmtool_posix.0 Request processed in 191us (3366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830063.572764:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 42 00000100:00100000:1.0:1787830063.579727:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830063.579834:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275785728 00000100:00100000:3.0:1787830063.579852:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275785728 00000100:00100000:3.0:1787830063.579919:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 43 00000100:00100000:3.0:1787830063.579930:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+15:14517:x1874675275785728:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787830063.579962:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830063.579986:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8e44 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8c94 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787830063.582188:0:14329:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:3.0:1787830063.582200:0:14329:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1787830063.582249:0:14329:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:3.0:1787830063.583660:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8e4b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.583682:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8e4b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.583695:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8e4b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.583782:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8e44 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c94 expref: 18 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.584683:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8e4b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c94 expref: 17 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.584695:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:3.0:1787830063.584698:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787830063.584702:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b40030e00, rc 0) 00000100:00100000:2.0:1787830063.589235:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+17:14517:x1874675275785728:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 9294us (9507us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1787830063.589250:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 43 00000100:00100000:3.0:1787830063.595113:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830063.595958:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275785984 00000100:00100000:1.0:1787830063.595969:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275785984 00000100:00100000:1.0:1787830063.596077:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 44 00000100:00100000:1.0:1787830063.596088:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bad48885-a767-440f-85b6-3e1bee305ba5+17:14517:x1874675275785984:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787830063.596152:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830063.596182:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8e4b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c94 expref: 17 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.596202:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e9b478cc200) 00010000:00010000:1.0:1787830063.596212:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787830063.596238:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d8e59 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.596251:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d8e59 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.596272:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d8e59 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.596335:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8e60 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6f94cbea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.596343:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8e60 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6f94cbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.596350:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8e60 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6f94cbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.596633:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d8e59 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.596647:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d8e59 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.596655:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d8e59 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.596660:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feefa00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787830063.596665:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d8e59 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.596672:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d8e59 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.596680:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e9b478cc400) 00010000:00010000:1.0:1787830063.596682:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830063.596686:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d8e59 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.596691:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d8e59 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.596700:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8e60 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6f94cbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.596705:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8e60 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6f94cbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.596711:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8e60 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6f94cbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.596716:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feee000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:1.0:1787830063.596724:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8e60 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6f94cbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.596731:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8e60 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6f94cbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.596738:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x6f94cbea (ffff9e9b507a7200) 00010000:00010000:1.0:1787830063.596741:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830063.596744:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8e60 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6f94cbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.596749:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8e60 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6f94cbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830063.598972:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bad48885-a767-440f-85b6-3e1bee305ba5+16:14517:x1874675275785984:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 Request processed in 2865us (3847us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787830063.598984:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 44 00000100:00100000:1.0:1787830063.605118:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830063.605262:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275786112 00000100:00100000:2.0:1787830063.605272:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275786112 00000100:00100000:2.0:1787830063.605336:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 45 00000100:00100000:2.0:1787830063.605348:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+16:14517:x1874675275786112:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787830063.605368:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830063.605393:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bda00/0xc03b4d103c0d8e67 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8c9b expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.605429:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bc000/0xc03b4d103c0d8e6e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.605443:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bc000/0xc03b4d103c0d8e6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.606557:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bc000/0xc03b4d103c0d8e6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.606671:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bda00/0xc03b4d103c0d8e67 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c9b expref: 18 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.606692:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bc000/0xc03b4d103c0d8e6e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c9b expref: 17 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.606714:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e9b45193100) 00010000:00010000:2.0:1787830063.606718:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787830063.606722:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9a437bc000, rc 0) 00000100:00100000:2.0:1787830063.607303:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+17:14517:x1874675275786112:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 1956us (2192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830063.607313:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 45 00000100:00100000:2.0:1787830063.625511:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830063.625617:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275786368 00000100:00100000:1.0:1787830063.625627:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275786368 00000100:00100000:1.0:1787830063.625691:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 46 00000100:00100000:1.0:1787830063.625701:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bad48885-a767-440f-85b6-3e1bee305ba5+17:14517:x1874675275786368:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787830063.625789:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8e75 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.625820:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8e75 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.625832:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8e75 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787830063.626248:0:14330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1787830063.626268:0:14330:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 443527249941ns, next at 444527247099ns, rc = 0 00000004:00010000:1.0:1787830063.626362:0:14330:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f45fe54d reply state 000000008c3f9216 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8e75 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830063.626372:0:14330:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787830063.626477:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bad48885-a767-440f-85b6-3e1bee305ba5+19:14517:x1874675275786368:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 Request processed in 776us (974us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1787830063.626486:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 46 00010000:00010000:3.0:1787830063.629305:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8e75 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.629322:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8e75 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.629330:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8e75 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.629350:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feee000 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:3.0:1787830063.629355:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8e75 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.629363:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8e75 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.629380:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e9b45193100) 00010000:00010000:3.0:1787830063.629383:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787830063.629388:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8e75 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.629394:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feee000/0xc03b4d103c0d8e75 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830063.630661:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830063.631013:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275786496 00000100:00100000:0.0:1787830063.631064:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275786496 00000100:00100000:0.0:1787830063.631113:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 47 00000100:00100000:0.0:1787830063.631122:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f382940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+18:14517:x1874675275786496:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787830063.631157:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830063.631177:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06600/0xc03b4d103c0d8e7c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8ca2 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.631239:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06600/0xc03b4d103c0d8e7c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8ca2 expref: 19 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.631253:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06600/0xc03b4d103c0d8e7c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8ca2 expref: 19 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.631284:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e9b45193100) 00010000:00010000:0.0:1787830063.631288:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787830063.631291:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b6fd06600, rc 0) 00000100:00100000:0.0:1787830063.631352:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f382940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+19:14517:x1874675275786496:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 231us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830063.631360:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 47 00000100:00100000:2.0:1787830063.648200:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830063.648321:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275786624 00000100:00100000:0.0:1787830063.648331:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275786624 00000100:00100000:0.0:1787830063.648418:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 13 00000100:00100000:0.0:1787830063.648430:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f383480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bad48885-a767-440f-85b6-3e1bee305ba5+5:2363:x1874675275786624:12345-192.168.201.51@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787830063.648819:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f383480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bad48885-a767-440f-85b6-3e1bee305ba5+6:2363:x1874675275786624:12345-192.168.201.51@tcp:2:lhsmtool_posix.0 Request processed in 390us (628us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787830063.648828:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 13 00000100:00080000:1.0:1787830063.651044:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787830063.652363:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830063.652642:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275786880 00000100:00100000:2.0:1787830063.652652:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275786880 00000100:00100000:2.0:1787830063.652710:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 9 00000100:00100000:2.0:1787830063.652720:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fb63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bad48885-a767-440f-85b6-3e1bee305ba5+19:14517:x1874675275786880:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787830063.652996:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fb63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bad48885-a767-440f-85b6-3e1bee305ba5+20:14517:x1874675275786880:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 Request processed in 276us (641us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1787830063.653004:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 9 00000100:00100000:3.0:1787830063.668337:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830063.669075:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275787136 00000100:00100000:2.0:1787830063.669086:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275787136 00000100:00100000:2.0:1787830063.669156:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 48 00000100:00100000:2.0:1787830063.669165:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+20:14517:x1874675275787136:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787830063.669295:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+20:14517:x1874675275787136:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 Request processed in 131us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830063.669304:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 48 00000100:00100000:2.0:1787830063.680299:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830063.680425:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275787264 00000100:00100000:1.0:1787830063.680437:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275787264 00000100:00100000:1.0:1787830063.680509:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 49 00000100:00100000:1.0:1787830063.680520:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bad48885-a767-440f-85b6-3e1bee305ba5+20:14517:x1874675275787264:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787830063.680544:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830063.680570:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d8e83 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8ca9 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.680642:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef600/0xc03b4d103c0d8e8a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.680657:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef600/0xc03b4d103c0d8e8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.680668:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef600/0xc03b4d103c0d8e8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787830063.680705:0:14330:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787830063.680735:0:14330:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef600/0xc03b4d103c0d8e8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.680764:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feefa00/0xc03b4d103c0d8e83 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8ca9 expref: 22 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.680781:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef600/0xc03b4d103c0d8e8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8ca9 expref: 21 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.680789:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e9b45193100) 00010000:00010000:1.0:1787830063.680792:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787830063.680807:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feef600, rc 0) 00000100:00100000:1.0:1787830063.681001:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bad48885-a767-440f-85b6-3e1bee305ba5+21:14517:x1874675275787264:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 481us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830063.681008:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 49 00000100:00100000:3.0:1787830063.686488:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830063.686671:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275787392 00000100:00100000:1.0:1787830063.686681:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275787392 00000100:00100000:1.0:1787830063.686742:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 14 00000100:00100000:1.0:1787830063.686753:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fe79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bad48885-a767-440f-85b6-3e1bee305ba5+6:2360:x1874675275787392:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787830063.686770:0:15015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830063.686790:0:15015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cfcb054/0xc03b4d103c0d8e91 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8cb0 expref: -99 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787830063.686822:0:15015:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a901f30, blocks: 0x1 00010000:00010000:1.0:1787830063.686841:0:15015:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1787830063.686846:0:15015:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830063.686857:0:15015:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cfcb054/0xc03b4d103c0d8e91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8cb0 expref: 7 pid: 15015 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.686894:0:15015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007cfcb054/0xc03b4d103c0d8e91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8cb0 expref: 7 pid: 15015 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.686906:0:15015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feefa00, rc 0) 00000100:00100000:1.0:1787830063.686976:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fe79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bad48885-a767-440f-85b6-3e1bee305ba5+7:2360:x1874675275787392:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 224us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830063.686983:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 14 00000100:00100000:3.0:1787830063.698116:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830063.698223:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275787648 00000100:00100000:0.0:1787830063.698234:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275787648 00000100:00100000:0.0:1787830063.698308:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 50 00000100:00100000:0.0:1787830063.698318:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ed03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+21:14517:x1874675275787648:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787830063.698441:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ed03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bad48885-a767-440f-85b6-3e1bee305ba5+21:14517:x1874675275787648:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 Request processed in 123us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830063.698458:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 50 00000100:00100000:2.0:1787830063.709205:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830063.709305:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275787776 00000100:00100000:1.0:1787830063.709315:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275787776 00000100:00100000:1.0:1787830063.709378:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 51 00000100:00100000:1.0:1787830063.709388:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bad48885-a767-440f-85b6-3e1bee305ba5+21:14517:x1874675275787776:12345-192.168.201.51@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787830063.812855:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000001:00080000:0.0:1787830063.812886:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:0.0:1787830063.812892:0:5827:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1787830063.813052:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284158080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787830063.813118:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830063.813198:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284158080 00000100:00100000:0.0:1787830063.813207:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284158080 00000100:00100000:0.0:1787830063.813273:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787830063.813283:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284158080:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787830063.813758:0:15016:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787830063.813763:0:15016:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1787830063.813765:0:15016:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787830063.813767:0:15016:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787830064 -> 1787830064 00002000:00010000:0.0:1787830063.813769:0:15016:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787830063.813978:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3278:x1874675284158080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 695us (858us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787830063.813986:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787830063.814343:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bad48885-a767-440f-85b6-3e1bee305ba5+18:14517:x1874675275787776:12345-192.168.201.51@tcp:44:lhsmtool_posix.0 Request processed in 104954us (105144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830063.814352:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 51 00000001:00080000:2.0:1787830063.814413:0:5827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:3.0:1787830063.821090:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000004:00080000:1.0:1787830063.822361:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e9b5955e940/2, rc 0, transno 8589934595 00000100:00100000:1.0:1787830063.822375:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284158080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787830063.823080:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275787904 00000100:00100000:0.0:1787830063.823088:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275787904 00000100:00100000:0.0:1787830063.823150:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 16 00000100:00100000:0.0:1787830063.823174:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bad48885-a767-440f-85b6-3e1bee305ba5+7:2363:x1874675275787904:12345-192.168.201.51@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787830063.823311:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bad48885-a767-440f-85b6-3e1bee305ba5+7:2363:x1874675275787904:12345-192.168.201.51@tcp:16:lhsmtool_posix.0 Request processed in 139us (2229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830063.823320:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 16 00000100:00100000:0.0:1787830063.829914:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830063.830619:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275788160 00000100:00100000:2.0:1787830063.830630:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275788160 00000100:00100000:3.0:1787830063.830815:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 52 00000100:00100000:3.0:1787830063.830826:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+14:14517:x1874675275788160:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787830063.830890:0:14328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830063.830918:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b7feef600/0xc03b4d103c0d8e8a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8ca9 expref: 14 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.830951:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e9b45193100) 00010000:00010000:3.0:1787830063.830969:0:14328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787830063.831001:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8e98 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.831058:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8e98 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.831069:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8e98 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787830063.831278:0:14328:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8b65bee reply state 00000000eb896425 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8e98 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830063.831288:0:14328:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787830063.831437:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+15:14517:x1874675275788160:12345-192.168.201.51@tcp:36:lhsmtool_posix.0 Request processed in 612us (1533us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1787830063.831457:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 52 00000100:00100000:2.0:1787830063.840303:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830063.840387:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275788288 00000100:00100000:1.0:1787830063.840398:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275788288 00000100:00100000:1.0:1787830063.840466:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 17 00000100:00100000:1.0:1787830063.840476:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f383c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bad48885-a767-440f-85b6-3e1bee305ba5+7:14517:x1874675275788288:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787830063.840494:0:15016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830063.840513:0:15016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8ca1f36/0xc03b4d103c0d8e9f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53172783628c8cb7 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.840547:0:15016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007cfcb054/0xc03b4d103c0d8e91 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8cb0 expref: 8 pid: 15015 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.840572:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830063.840577:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830063.840583:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8ca1f36/0xc03b4d103c0d8e9f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8cb7 expref: 8 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.840617:0:15016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007cfcb054/0xc03b4d103c0d8e91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8cb0 expref: 8 pid: 15015 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.840631:0:15016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007cfcb054/0xc03b4d103c0d8e91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8cb0 expref: 8 pid: 15015 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830063.840645:0:15016:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7fec52c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15016:1874675284158208:192.168.201.51@tcp:104: 00000100:00100000:1.0:1787830063.840734:0:15016:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b69e3ecc0 going to sleep for 11 seconds 00010000:00010000:0.0:1787830063.840962:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8e98 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.840972:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8e98 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.840979:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8e98 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.840986:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40030400 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787830063.840991:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8e98 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.841000:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8e98 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.841032:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e9b45193100) 00010000:00010000:0.0:1787830063.841035:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830063.841040:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8e98 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.841046:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030400/0xc03b4d103c0d8e98 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830063.852751:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830063.852917:0:15016:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7fec52c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15016:1874675284158208:192.168.201.51@tcp:104: 00010000:00010000:1.0:1787830063.852949:0:15016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b8ca1f36/0xc03b4d103c0d8e9f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c8cb7 expref: 8 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.852972:0:15016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b7feefc00, rc 0) 00000100:00100000:3.0:1787830063.853077:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275788416 00000100:00100000:3.0:1787830063.853083:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275788416 00010000:00010000:3.0:1787830063.853114:0:14313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007cfcb054/0xc03b4d103c0d8e91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8cb0 expref: 9 pid: 15015 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830063.853146:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 13 00000100:00100000:3.0:1787830063.853154:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bad48885-a767-440f-85b6-3e1bee305ba5+9:2362:x1874675275788416:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787830063.853168:0:14313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830063.853190:0:14313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007cfcb054/0xc03b4d103c0d8e91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8cb0 expref: 9 pid: 15015 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.853210:0:14313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007cfcb054/0xc03b4d103c0d8e91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8cb0 expref: 9 pid: 15015 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.853232:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cfcb054/0xc03b4d103c0d8e91 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8cb0 expref: 9 pid: 15015 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.853247:0:14313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830063.853264:0:14313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830063.853271:0:14313:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8ca1f36/0xc03b4d103c0d8e9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c8cb7 expref: 8 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.853281:0:14313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8ca1f36/0xc03b4d103c0d8e9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c8cb7 expref: 8 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.853315:0:14313:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b8ca1f36/0xc03b4d103c0d8e9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c8cb7 expref: 8 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830063.853333:0:14313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed3c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14313:1874675284158336:192.168.201.51@tcp:105: 00000100:00100000:1.0:1787830063.859006:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f383c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bad48885-a767-440f-85b6-3e1bee305ba5+8:14517:x1874675275788288:12345-192.168.201.51@tcp:101:lhsmtool_posix.0 Request processed in 18519us (18701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830063.859034:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 17 00000100:00100000:3.0:1787830063.859188:0:14313:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4fa6ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830063.866953:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830063.867072:0:14313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed3c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14313:1874675284158336:192.168.201.51@tcp:105: 00010000:00010000:3.0:1787830063.867097:0:14313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787830063.867142:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bad48885-a767-440f-85b6-3e1bee305ba5+7:2362:x1874675275788416:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 13988us (14401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830063.867173:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 13 00000100:00100000:2.0:1787830063.869682:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275788544 00000100:00100000:2.0:1787830063.869696:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275788544 00000100:00100000:2.0:1787830063.869805:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 18 00000100:00100000:2.0:1787830063.869816:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bad48885-a767-440f-85b6-3e1bee305ba5+7:2362:x1874675275788544:12345-192.168.201.51@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787830063.870159:0:15015:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787830063.870163:0:15015:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787830063 00002000:00010000:2.0:1787830063.870166:0:15015:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787830062 00002000:00010000:2.0:1787830063.870168:0:15015:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787830064 -> 1787830063 00002000:00010000:2.0:1787830063.870171:0:15015:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787830063.870246:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bad48885-a767-440f-85b6-3e1bee305ba5+8:2362:x1874675275788544:12345-192.168.201.51@tcp:2:lhsmtool_posix.0 Request processed in 431us (3303us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787830063.870285:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 18 00000100:00100000:0.0:1787830063.875584:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830063.876766:0:15414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275788672 00000100:00100000:3.0:1787830063.876780:0:15414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275788672 00000100:00100000:3.0:1787830063.876850:0:15414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 19 00000100:00100000:3.0:1787830063.876861:0:15414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bad48885-a767-440f-85b6-3e1bee305ba5+8:2362:x1874675275788672:12345-192.168.201.51@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787830063.876903:0:15414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007f314106/0xc03b4d103c0d8ea6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.876921:0:15414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8ca1f36/0xc03b4d103c0d8e9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.51@tcp remote: 0x53172783628c8cb7 expref: 8 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.876930:0:15414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830063.876934:0:15414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787830063.876939:0:15414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f314106/0xc03b4d103c0d8ea6 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.876975:0:15414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b8ca1f36/0xc03b4d103c0d8e9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8cb7 expref: 8 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.876989:0:15414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b8ca1f36/0xc03b4d103c0d8e9f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8cb7 expref: 8 pid: 15016 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830063.877002:0:15414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed3c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15414:1874675284158464:192.168.201.51@tcp:104: 00000100:00100000:3.0:1787830063.877098:0:15414:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4fa6ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830063.880700:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830063.880789:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275788800 00000100:00100000:1.0:1787830063.880798:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275788800 00010000:00010000:1.0:1787830063.880858:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b8ca1f36/0xc03b4d103c0d8e9f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8cb7 expref: 9 pid: 15016 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830063.880896:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 14 00000100:00100000:1.0:1787830063.880904:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bad48885-a767-440f-85b6-3e1bee305ba5+9:2363:x1874675275788800:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787830063.880918:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830063.880937:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b8ca1f36/0xc03b4d103c0d8e9f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8cb7 expref: 9 pid: 15016 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.880951:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b8ca1f36/0xc03b4d103c0d8e9f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8cb7 expref: 9 pid: 15016 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.880983:0:14315:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787830063.880988:0:14315:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787830063.880994:0:14315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007f314106/0xc03b4d103c0d8ea6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.881004:0:14315:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f314106/0xc03b4d103c0d8ea6 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830063.881042:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787830063.881083:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bad48885-a767-440f-85b6-3e1bee305ba5+9:2363:x1874675275788800:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 179us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830063.881090:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 14 00010000:00010000:3.0:1787830063.884772:0:15414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8ca1f36/0xc03b4d103c0d8e9f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.51@tcp remote: 0x53172783628c8cb7 expref: 8 pid: 15016 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830063.884814:0:15414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed3c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15414:1874675284158464:192.168.201.51@tcp:104: 00010000:00010000:3.0:1787830063.884851:0:15414:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007f314106/0xc03b4d103c0d8ea6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.884863:0:15414:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007f314106/0xc03b4d103c0d8ea6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.884871:0:15414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f314106/0xc03b4d103c0d8ea6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.884909:0:15414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007f314106/0xc03b4d103c0d8ea6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.884917:0:15414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f314106/0xc03b4d103c0d8ea6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.884925:0:15414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f314106/0xc03b4d103c0d8ea6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.884932:0:15414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40030e00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:3.0:1787830063.884936:0:15414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f314106/0xc03b4d103c0d8ea6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.884945:0:15414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f314106/0xc03b4d103c0d8ea6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.884983:0:15414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f314106/0xc03b4d103c0d8ea6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.884991:0:15414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f314106/0xc03b4d103c0d8ea6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830063.885124:0:15414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bad48885-a767-440f-85b6-3e1bee305ba5+7:2362:x1874675275788672:12345-192.168.201.51@tcp:1:lhsmtool_posix.0 Request processed in 8263us (9548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830063.885134:0:15414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 19 00000100:00100000:0.0:1787830063.890261:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830063.890349:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275789056 00000100:00100000:3.0:1787830063.890359:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275789056 00000100:00100000:3.0:1787830063.890419:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 53 00000100:00100000:3.0:1787830063.890430:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bad48885-a767-440f-85b6-3e1bee305ba5+14:14517:x1874675275789056:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787830063.890530:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8ead lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.890547:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8ead lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.890558:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8ead lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.890819:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8eb4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.890831:0:14330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06600/0xc03b4d103c0d8e7c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8ca2 expref: 15 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.890862:0:14330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8eb4 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.890898:0:14330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06600/0xc03b4d103c0d8e7c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ca2 expref: 15 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.890911:0:14330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06600/0xc03b4d103c0d8e7c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ca2 expref: 15 pid: 14329 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830063.890927:0:14330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14330:1874675284158592:192.168.201.51@tcp:104: 00000100:00100000:3.0:1787830063.891055:0:14330:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4fa6ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830063.896165:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830063.896301:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275789184 00000100:00100000:2.0:1787830063.896310:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275789184 00010000:00010000:2.0:1787830063.896350:0:14314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06600/0xc03b4d103c0d8e7c lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ca2 expref: 16 pid: 14329 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830063.896397:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 15 00000100:00100000:2.0:1787830063.896408:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5955fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bad48885-a767-440f-85b6-3e1bee305ba5+16:2363:x1874675275789184:12345-192.168.201.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830063.896425:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830063.896431:0:14314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06600/0xc03b4d103c0d8e7c lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ca2 expref: 16 pid: 14329 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.896478:0:14314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06600/0xc03b4d103c0d8e7c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ca2 expref: 16 pid: 14329 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.896502:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e9b45193100) 00010000:00010000:2.0:1787830063.896507:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8eb4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.896517:0:14314:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8eb4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.896525:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8eb4 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.896546:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830063.896597:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bad48885-a767-440f-85b6-3e1bee305ba5+16:2363:x1874675275789184:12345-192.168.201.51@tcp:103:ldlm_bl.0 Request processed in 190us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830063.896605:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 15 00010000:00010000:3.0:1787830063.897934:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd06600/0xc03b4d103c0d8e7c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.51@tcp remote: 0x53172783628c8ca2 expref: 15 pid: 14329 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830063.897955:0:14330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14330:1874675284158592:192.168.201.51@tcp:104: 00010000:00010000:3.0:1787830063.897979:0:14330:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8eb4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.897988:0:14330:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8eb4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.897993:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8eb4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787830063.898235:0:14330:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1787830063.898388:0:14330:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1787830063.898433:0:14330:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1787830063.898979:0:14330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b52387840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14330:1874675284158720:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787830063.899109:0:14330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830063.899141:0:14330:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b44ffb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830063.899626:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284158720 00000100:00100000:3.0:1787830063.899635:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284158720 00000100:00100000:3.0:1787830063.899727:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787830063.899737:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b52385a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14330:x1874675284158720:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787830063.899827:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b52385a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14330:x1874675284158720:12345-0@lo:1000:mdt00_002.0 Request processed in 91us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830063.899845:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787830063.899918:0:14330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b52387840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14330:1874675284158720:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787830063.903105:0:14330:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787830063.903206:0:14330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b52387840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14330:1874675284158848:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787830063.903287:0:14330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830063.911605:0:14330:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b47ab6180 going to sleep for 11 seconds 00000100:00100000:1.0:1787830063.921799:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284158848 00000100:00100000:1.0:1787830063.921817:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284158848 00000100:00100000:1.0:1787830063.921899:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787830063.921926:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b5455a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14330:x1874675284158848:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787830063.922243:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5455a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14330:x1874675284158848:12345-0@lo:1000:mdt00_002.0 Request processed in 319us (18955us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787830063.922267:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787830063.922395:0:14330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b52387840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14330:1874675284158848:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787830063.922440:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8eb4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.922460:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8eb4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.922467:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8eb4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.922474:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40031200 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787830063.922478:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8eb4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.922486:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8eb4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.922503:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e9b45193100) 00010000:00010000:0.0:1787830063.922506:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787830063.922511:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8eb4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.922517:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031200/0xc03b4d103c0d8eb4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.922551:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8e0c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.922565:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8e0c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.922571:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8e0c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.922576:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40031a00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:0.0:1787830063.922579:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8e0c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.922586:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8e0c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.922595:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:0.0:1787830063.922598:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787830063.922605:0:14330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8e13 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c86 expref: 18 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.922616:0:14330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8e13 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c86 expref: 18 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.922625:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8e13 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c86 expref: 18 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830063.922686:0:14330:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b6fd07600/0xc03b4d103c0d8e13 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.51@tcp remote: 0x53172783628c8c86 expref: 18 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830063.922701:0:14330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b7f99bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14330:1874675284158976:192.168.201.51@tcp:105: 00000100:00100000:0.0:1787830063.922792:0:14330:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b4f8dc480 going to sleep for 11 seconds 00010000:00010000:2.0:1787830063.930688:0:15985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830063.936490:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:3.0:1787830063.936568:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275789312 00000100:00100000:3.0:1787830063.936578:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275789312 00000100:00100000:3.0:1787830063.936637:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 10 00000100:00100000:3.0:1787830063.936646:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7695cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bad48885-a767-440f-85b6-3e1bee305ba5+19:14516:x1874675275789312:12345-192.168.201.51@tcp:49:dd.0 00000100:00100000:3.0:1787830063.936773:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7695cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bad48885-a767-440f-85b6-3e1bee305ba5+19:14516:x1874675275789312:12345-192.168.201.51@tcp:49:dd.0 Request processed in 128us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830063.936782:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 10 00000100:00100000:2.0:1787830063.937189:0:14330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b7f99bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14330:1874675284158976:192.168.201.51@tcp:105: 00010000:00010000:2.0:1787830063.937234:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8e0c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.937245:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40031a00/0xc03b4d103c0d8e0c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.937293:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bde00/0xc03b4d103c0d8ebb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.937309:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bde00/0xc03b4d103c0d8ebb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.937321:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bde00/0xc03b4d103c0d8ebb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.937330:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bde00/0xc03b4d103c0d8ebb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.937336:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bde00/0xc03b4d103c0d8ebb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.937342:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bde00/0xc03b4d103c0d8ebb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.937348:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9a437bde00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787830063.937352:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bde00/0xc03b4d103c0d8ebb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.937358:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bde00/0xc03b4d103c0d8ebb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.937369:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:2.0:1787830063.937379:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830063.937383:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bde00/0xc03b4d103c0d8ebb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.937389:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bde00/0xc03b4d103c0d8ebb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.937400:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8ead lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.937406:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8ead lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.937411:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8ead lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.937416:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40030e00 already unused, calling callback (ffffffffc20614f0) 00010000:00010000:2.0:1787830063.937419:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8ead lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.937424:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8ead lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.937431:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e9b478cce00) 00010000:00010000:2.0:1787830063.937434:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787830063.937436:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8ead lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.937442:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b40030e00/0xc03b4d103c0d8ead lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830063.937650:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b5955cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bad48885-a767-440f-85b6-3e1bee305ba5+18:14517:x1874675275789056:12345-192.168.201.51@tcp:57:lhsmtool_posix.0 Request processed in 47222us (47411us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787830063.937668:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 53 00000020:00080000:2.0:1787830063.937672:0:14330:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787830063.937852:0:14362:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787830063.937859:0:14362:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787830063.937886:0:14362:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787830063.937892:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787830063.950538:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830063.950619:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275789568 00000100:00100000:2.0:1787830063.950630:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275789568 00000100:00100000:2.0:1787830063.950691:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 11 00000100:00100000:2.0:1787830063.950702:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b48ed3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bad48885-a767-440f-85b6-3e1bee305ba5+18:14517:x1874675275789568:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787830063.951467:0:14331:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787830063.951582:0:14331:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1787830063.951624:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd200/0xc03b4d103c0d8ec2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.951641:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd200/0xc03b4d103c0d8ec2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.951653:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd200/0xc03b4d103c0d8ec2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.951663:0:14331:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd200/0xc03b4d103c0d8ec2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.951669:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd200/0xc03b4d103c0d8ec2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.951675:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd200/0xc03b4d103c0d8ec2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830063.951700:0:14331:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787830063.951793:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b48ed3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bad48885-a767-440f-85b6-3e1bee305ba5+20:14517:x1874675275789568:12345-192.168.201.51@tcp:35:lhsmtool_posix.0 Request processed in 1091us (1262us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1787830063.951813:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 11 00000020:00080000:2.0:1787830063.951817:0:14331:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787830063.951997:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787830063.952004:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd200/0xc03b4d103c0d8ec2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.952012:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9a437bd200 already unused, calling callback (ffffffffc1651420) 00010000:00010000:3.0:1787830063.952041:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd200/0xc03b4d103c0d8ec2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.952052:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd200/0xc03b4d103c0d8ec2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.952074:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e9b45193100) 00010000:00010000:3.0:1787830063.952077:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787830063.952081:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd200/0xc03b4d103c0d8ec2 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.952087:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9a437bd200/0xc03b4d103c0d8ec2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830063.952101:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830063.952103:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830063.952104:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830064.214419:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830064.214555:0:15019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275789696 00000100:00100000:2.0:1787830064.214565:0:15019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275789696 00000100:00100000:2.0:1787830064.214644:0:15019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 0 00000100:00100000:2.0:1787830064.214654:0:15019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f99a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bad48885-a767-440f-85b6-3e1bee305ba5+7:2362:x1874675275789696:12345-192.168.201.51@tcp:4:dd.0 00002000:00010000:2.0:1787830064.214711:0:15019:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a901f2f, atime: 0x6a901f2e, ctime: 0x6a901f2f, blocks: 0x1 00010000:00010000:2.0:1787830064.214720:0:15019:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8ec9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830064.214739:0:15019:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1787830064.214745:0:15019:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830064.214753:0:15019:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8ec9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830064.214770:0:15019:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8ec9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830064.232388:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830064.232582:0:15021:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787830064.232598:0:15021:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1787830064.234054:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275789824 00000100:00100000:2.0:1787830064.234070:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275789824 00000100:00100000:1.0:1787830064.234798:0:16565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 1 00000100:00100000:1.0:1787830064.234820:0:16565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f99bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bad48885-a767-440f-85b6-3e1bee305ba5+9:2363:x1874675275789824:12345-192.168.201.51@tcp:4:dd.0 00010000:00010000:1.0:1787830064.234862:0:16565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff9c16c0/0xc03b4d103c0d8ed0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830064.234882:0:16565:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830064.234887:0:16565:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830064.234894:0:16565:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff9c16c0/0xc03b4d103c0d8ed0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830064.234909:0:16565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff9c16c0/0xc03b4d103c0d8ed0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830064.249467:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830064.249513:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830064.249692:0:15021:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787830064.249781:0:15021:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1787830064.251476:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830064.251558:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830064.251588:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:0.0:1787830064.251605:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830064.253460:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275789952 00000100:00100000:2.0:1787830064.253480:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275789952 00000100:00100000:2.0:1787830064.253570:0:15021:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787830064.254494:0:15020:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787830064.254516:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275790080 00000100:00100000:3.0:1787830064.254522:0:15020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275790080 00000100:00100000:3.0:1787830064.254562:0:15020:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787830064.254567:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275790208 00000100:00100000:3.0:1787830064.254570:0:15020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275790208 00000100:00100000:1.0:1787830064.256884:0:16566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275790336 00000100:00100000:1.0:1787830064.256899:0:16566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275790336 00000100:00100000:1.0:1787830064.256944:0:16566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275790464 00000100:00100000:1.0:1787830064.256947:0:16566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275790464 00000100:00100000:1.0:1787830064.256960:0:16566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275790592 00000100:00100000:1.0:1787830064.256962:0:16566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275790592 00000100:00100000:1.0:1787830064.256985:0:16566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 2 00000100:00100000:1.0:1787830064.256994:0:16566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f310b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bad48885-a767-440f-85b6-3e1bee305ba5+15:2362:x1874675275789952:12345-192.168.201.51@tcp:4:dd.0 00010000:00010000:1.0:1787830064.257057:0:16566:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3e87b21/0xc03b4d103c0d8ed7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830064.257087:0:16566:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830064.257091:0:16566:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830064.257098:0:16566:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3e87b21/0xc03b4d103c0d8ed7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830064.257112:0:16566:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3e87b21/0xc03b4d103c0d8ed7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830064.260204:0:15021:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:0.0:1787830064.265607:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 3 00000100:00100000:0.0:1787830064.265627:0:16567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bad48885-a767-440f-85b6-3e1bee305ba5+17:2363:x1874675275790080:12345-192.168.201.51@tcp:4:dd.0 00010000:00010000:0.0:1787830064.265670:0:16567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081487eda/0xc03b4d103c0d8ede lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830064.265688:0:16567:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830064.265693:0:16567:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830064.265700:0:16567:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081487eda/0xc03b4d103c0d8ede lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830064.265714:0:16567:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081487eda/0xc03b4d103c0d8ede lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787830064.384941:0:7602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:1.0:1787830064.384961:0:7602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:1.0:1787830064.384968:0:7602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:2.0:1787830064.385003:0:15019:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1787830064.385012:0:15019:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787830063 -> 1787830064 00002000:00010000:2.0:1787830064.385065:0:15019:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787830063 -> 1787830064 00002000:00010000:2.0:1787830064.385069:0:15019:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:2.0:1787830064.385089:0:15019:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8ec9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830064.385105:0:15019:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8ec9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830064.385114:0:15019:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8ec9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830064.385122:0:15019:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9a437bde00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:2.0:1787830064.385310:0:15019:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8ec9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830064.385322:0:15019:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8ec9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830064.385354:0:15019:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8ec9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830064.385363:0:15019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8ec9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830064.385860:0:15019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f99a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bad48885-a767-440f-85b6-3e1bee305ba5+21:2362:x1874675275789696:12345-192.168.201.51@tcp:4:dd.0 Request processed in 171198us (171444us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1787830064.385886:0:15019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 0 00000100:00100000:2.0:1787830064.385939:0:15019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 4 00000100:00100000:2.0:1787830064.385954:0:15019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f311680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bad48885-a767-440f-85b6-3e1bee305ba5+20:2363:x1874675275790336:12345-192.168.201.51@tcp:4:dd.0 00010000:00010000:2.0:1787830064.386001:0:15019:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000117b8693/0xc03b4d103c0d8ee5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830064.386075:0:15019:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830064.386081:0:15019:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830064.386088:0:15019:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000117b8693/0xc03b4d103c0d8ee5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830064.386103:0:15019:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000117b8693/0xc03b4d103c0d8ee5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787830064.447974:0:16566:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:2.0:1787830064.447985:0:16566:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 8199 00010000:00010000:2.0:1787830064.448002:0:16566:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3e87b21/0xc03b4d103c0d8ed7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830064.448035:0:16566:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3e87b21/0xc03b4d103c0d8ed7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830064.448045:0:16566:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3e87b21/0xc03b4d103c0d8ed7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830064.448052:0:16566:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feeec00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:2.0:1787830064.448072:0:16566:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3e87b21/0xc03b4d103c0d8ed7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830064.448082:0:16566:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3e87b21/0xc03b4d103c0d8ed7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830064.448105:0:16566:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3e87b21/0xc03b4d103c0d8ed7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830064.448109:0:16567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081487eda/0xc03b4d103c0d8ede lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830064.448113:0:16566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3e87b21/0xc03b4d103c0d8ed7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830064.448119:0:16567:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081487eda/0xc03b4d103c0d8ede lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830064.448137:0:16567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081487eda/0xc03b4d103c0d8ede lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830064.448142:0:16567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b6fd07000 already unused, calling callback (ffffffffc1651420) 00010000:00010000:0.0:1787830064.448145:0:16567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081487eda/0xc03b4d103c0d8ede lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830064.448151:0:16567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081487eda/0xc03b4d103c0d8ede lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830064.448164:0:16567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081487eda/0xc03b4d103c0d8ede lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830064.448170:0:16567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081487eda/0xc03b4d103c0d8ede lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830064.448214:0:16566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f310b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bad48885-a767-440f-85b6-3e1bee305ba5+21:2362:x1874675275789952:12345-192.168.201.51@tcp:4:dd.0 Request processed in 191216us (198758us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787830064.448226:0:16566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 2 00010000:00010000:3.0:1787830064.448260:0:16565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff9c16c0/0xc03b4d103c0d8ed0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830064.448269:0:16565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff9c16c0/0xc03b4d103c0d8ed0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830064.448277:0:16565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff9c16c0/0xc03b4d103c0d8ed0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830064.448282:0:16565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b7feee600 already unused, calling callback (ffffffffc1651420) 00010000:00010000:3.0:1787830064.448285:0:16565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff9c16c0/0xc03b4d103c0d8ed0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830064.448304:0:16565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff9c16c0/0xc03b4d103c0d8ed0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830064.448315:0:16565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff9c16c0/0xc03b4d103c0d8ed0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830064.448322:0:16565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff9c16c0/0xc03b4d103c0d8ed0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830064.448390:0:16566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 5 00000100:00100000:2.0:1787830064.448403:0:16566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bad48885-a767-440f-85b6-3e1bee305ba5+19:2363:x1874675275790464:12345-192.168.201.51@tcp:4:dd.0 00000100:00100000:0.0:1787830064.448416:0:16567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bad48885-a767-440f-85b6-3e1bee305ba5+19:2363:x1874675275790080:12345-192.168.201.51@tcp:4:dd.0 Request processed in 182796us (198902us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787830064.448424:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 3 00010000:00010000:2.0:1787830064.448435:0:16566:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8eec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830064.448448:0:16566:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1787830064.448450:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 6 00010000:00010000:2.0:1787830064.448452:0:16566:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1787830064.448456:0:16567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbeed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bad48885-a767-440f-85b6-3e1bee305ba5+18:2363:x1874675275790592:12345-192.168.201.51@tcp:4:dd.0 00010000:00010000:2.0:1787830064.448459:0:16566:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8eec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830064.448470:0:16567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000430d52f8/0xc03b4d103c0d8ef3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830064.448472:0:16566:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8eec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830064.448478:0:16567:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830064.448486:0:16567:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830064.448491:0:16567:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000430d52f8/0xc03b4d103c0d8ef3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830064.448499:0:16567:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000430d52f8/0xc03b4d103c0d8ef3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787830064.448605:0:7602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00000100:00100000:3.0:1787830064.448679:0:16565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f99bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bad48885-a767-440f-85b6-3e1bee305ba5+18:2363:x1874675275789824:12345-192.168.201.51@tcp:4:dd.0 Request processed in 213866us (216309us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787830064.448687:0:16565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 1 00000100:00100000:3.0:1787830064.448704:0:16565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 7 00000100:00100000:3.0:1787830064.448713:0:16565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b74cf4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bad48885-a767-440f-85b6-3e1bee305ba5+17:2363:x1874675275790208:12345-192.168.201.51@tcp:4:dd.0 00010000:00010000:3.0:1787830064.448731:0:16565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061049211/0xc03b4d103c0d8efa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830064.448739:0:16565:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830064.448742:0:16565:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830064.448746:0:16565:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061049211/0xc03b4d103c0d8efa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830064.448754:0:16565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061049211/0xc03b4d103c0d8efa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787830064.510376:0:7602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:3.0:1787830064.513673:0:15019:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:3.0:1787830064.513683:0:15019:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 14343 00010000:00010000:3.0:1787830064.513698:0:15019:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000117b8693/0xc03b4d103c0d8ee5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830064.513713:0:15019:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000117b8693/0xc03b4d103c0d8ee5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830064.513722:0:15019:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000117b8693/0xc03b4d103c0d8ee5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830064.513729:0:15019:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9a437bca00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:3.0:1787830064.513734:0:15019:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000117b8693/0xc03b4d103c0d8ee5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830064.513743:0:15019:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000117b8693/0xc03b4d103c0d8ee5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830064.513763:0:15019:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000117b8693/0xc03b4d103c0d8ee5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830064.513770:0:15019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000117b8693/0xc03b4d103c0d8ee5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830064.513875:0:15019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f311680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bad48885-a767-440f-85b6-3e1bee305ba5+17:2363:x1874675275790336:12345-192.168.201.51@tcp:4:dd.0 Request processed in 127923us (262313us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1787830064.513905:0:15019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 4 00000001:00080000:2.0:1787830064.595935:0:7602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00000001:00080000:2.0:1787830064.595973:0:7602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:1.0:1787830064.596191:0:16565:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1787830064.596208:0:16565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061049211/0xc03b4d103c0d8efa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830064.596220:0:16565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061049211/0xc03b4d103c0d8efa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830064.596229:0:16565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061049211/0xc03b4d103c0d8efa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830064.596236:0:16565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b40031800 already unused, calling callback (ffffffffc1651420) 00010000:00010000:1.0:1787830064.596250:0:16565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061049211/0xc03b4d103c0d8efa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830064.596260:0:16565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061049211/0xc03b4d103c0d8efa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830064.596300:0:16565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061049211/0xc03b4d103c0d8efa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830064.596308:0:16565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061049211/0xc03b4d103c0d8efa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830064.596414:0:16565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b74cf4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bad48885-a767-440f-85b6-3e1bee305ba5+9:2363:x1874675275790208:12345-192.168.201.51@tcp:4:dd.0 Request processed in 147697us (344942us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787830064.596424:0:16565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 7 00010000:00010000:3.0:1787830064.596587:0:16566:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8eec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830064.596597:0:16566:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8eec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830064.596605:0:16566:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8eec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830064.596612:0:16566:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9a437bde00 already unused, calling callback (ffffffffc1651420) 00010000:00010000:3.0:1787830064.596615:0:16566:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8eec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830064.596623:0:16566:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8eec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830064.596634:0:16566:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8eec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830064.596641:0:16566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092cc8426/0xc03b4d103c0d8eec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830064.596676:0:16566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bad48885-a767-440f-85b6-3e1bee305ba5+7:2363:x1874675275790464:12345-192.168.201.51@tcp:4:dd.0 Request processed in 148278us (345087us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787830064.596684:0:16566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 5 00010000:00010000:3.0:1787830064.597256:0:16567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000430d52f8/0xc03b4d103c0d8ef3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830064.597268:0:16567:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000430d52f8/0xc03b4d103c0d8ef3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830064.597276:0:16567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000430d52f8/0xc03b4d103c0d8ef3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830064.597283:0:16567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b6fd07800 already unused, calling callback (ffffffffc1651420) 00010000:00010000:3.0:1787830064.597286:0:16567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000430d52f8/0xc03b4d103c0d8ef3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830064.597292:0:16567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000430d52f8/0xc03b4d103c0d8ef3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830064.597304:0:16567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000430d52f8/0xc03b4d103c0d8ef3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830064.597310:0:16567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000430d52f8/0xc03b4d103c0d8ef3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830064.597357:0:16567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbeed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bad48885-a767-440f-85b6-3e1bee305ba5+5:2363:x1874675275790592:12345-192.168.201.51@tcp:4:dd.0 Request processed in 148901us (345749us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787830064.597365:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 6 00010000:00010000:0.0:1787830064.930928:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830065.951336:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830065.951377:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830065.951406:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830065.951428:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830065.951441:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275790720 00000100:00100000:2.0:1787830065.951452:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275790720 00000100:00100000:1.0:1787830065.951453:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830065.951469:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:1.0:1787830065.951490:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.51@tcp (source: 12345-192.168.201.51@tcp) 00000100:00100000:2.0:1787830065.951503:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 124 00000100:00100000:2.0:1787830065.951512:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6f5fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c47ee9c-623b-47d7-a235-c0ef434319ba+13:2362:x1874675275790720:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787830065.951586:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6f5fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c47ee9c-623b-47d7-a235-c0ef434319ba+13:2362:x1874675275790720:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 75us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830065.951594:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 124 00000100:00100000:2.0:1787830065.951627:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275790976 00000100:00100000:2.0:1787830065.951630:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275790976 00000100:00100000:2.0:1787830065.951658:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275791488 00000100:00100000:2.0:1787830065.951660:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275791488 00000100:00100000:2.0:1787830065.951673:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275791104 00000100:00100000:2.0:1787830065.951675:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275791104 00000100:00100000:2.0:1787830065.951685:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275791360 00000100:00100000:2.0:1787830065.951687:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275791360 00000100:00100000:2.0:1787830065.951703:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 17 00000100:00100000:2.0:1787830065.951709:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bad48885-a767-440f-85b6-3e1bee305ba5+5:2362:x1874675275790976:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787830065.951732:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bad48885-a767-440f-85b6-3e1bee305ba5+5:2362:x1874675275790976:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 24us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830065.951738:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 17 00000100:00100000:2.0:1787830065.951748:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 18 00000100:00100000:2.0:1787830065.951753:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:612b807d-ada2-4e97-9e6f-ce18d749b2d4+5:2362:x1874675275791488:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787830065.951793:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:612b807d-ada2-4e97-9e6f-ce18d749b2d4+5:2362:x1874675275791488:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 40us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830065.951799:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 18 00000100:00100000:2.0:1787830065.951809:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 19 00000100:00100000:2.0:1787830065.951815:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bad48885-a767-440f-85b6-3e1bee305ba5+5:2362:x1874675275791104:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787830065.951831:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bad48885-a767-440f-85b6-3e1bee305ba5+5:2362:x1874675275791104:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 17us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830065.951837:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 19 00000100:00100000:2.0:1787830065.951846:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 20 00000100:00100000:2.0:1787830065.951850:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:612b807d-ada2-4e97-9e6f-ce18d749b2d4+5:2362:x1874675275791360:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:2.0:1787830065.951865:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:612b807d-ada2-4e97-9e6f-ce18d749b2d4+5:2362:x1874675275791360:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 15us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830065.951871:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 20 00000100:00080000:2.0:1787830065.951887:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787830065.951891:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787830065.952070:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275791232 00000100:00100000:3.0:1787830065.952074:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275791232 00000100:00100000:3.0:1787830065.952114:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675275790848 00000100:00100000:3.0:1787830065.952117:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675275790848 00000100:00100000:3.0:1787830065.952131:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 31 00000100:00100000:3.0:1787830065.952138:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:612b807d-ada2-4e97-9e6f-ce18d749b2d4+6:2362:x1874675275791232:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787830065.952170:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:612b807d-ada2-4e97-9e6f-ce18d749b2d4+6:2362:x1874675275791232:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 34us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830065.952177:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 31 00000100:00100000:3.0:1787830065.952189:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.51@tcp, seq: 32 00000100:00100000:3.0:1787830065.952195:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fec70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+20:2362:x1874675275790848:12345-192.168.201.51@tcp:400:kworker.0 00000100:00100000:3.0:1787830065.952244:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fec70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bad48885-a767-440f-85b6-3e1bee305ba5+20:2362:x1874675275790848:12345-192.168.201.51@tcp:400:kworker.0 Request processed in 48us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830065.952250:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.51@tcp, seq: 32 00000100:00080000:2.0:1787830065.952440:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787830065.959509:0:15985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787830066.018642:0:14362:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787830066.018655:0:14362:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787830066.018689:0:14362:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787830066.018694:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787830066.020399:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b48ed3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284159104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787830066.020473:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830066.024874:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284159104 00000100:00100000:2.0:1787830066.024890:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284159104 00000100:00080000:1.0:1787830066.024981:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787830066.025288:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787830066.025302:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7fbee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284159104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787830066.025350:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787830066.025632:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7fbee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284159104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 335us (5159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830066.025641:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787830066.025743:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b48ed3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284159104:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787830066.247649:0:16606:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1787830066.978481:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830067.554358:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284159360:0@lo:400:kworker.0 00000100:00100000:1.0:1787830067.554435:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830067.554491:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1874675284159872:0@lo:400:kworker.0 00000100:00100000:1.0:1787830067.554529:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830067.554558:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787830067.554564:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3281:1874675284159232:0@lo:400:kworker.0 00000100:00100000:1.0:1787830067.554592:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830067.554615:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1874675284159744:0@lo:400:kworker.0 00000100:00100000:1.0:1787830067.554637:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830067.554668:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284159488:0@lo:400:kworker.0 00000100:00100000:1.0:1787830067.554692:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830067.554711:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787830067.554716:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9a424f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284159616:0@lo:400:kworker.0 00000100:00100000:1.0:1787830067.554752:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830067.554797:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284159360 00000100:00100000:1.0:1787830067.554803:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284159360 00000100:00100000:1.0:1787830067.554851:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284159488 00000100:00100000:1.0:1787830067.554855:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284159488 00000100:00100000:1.0:1787830067.554886:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787830067.554896:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284159360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830067.554947:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874675284159360:12345-0@lo:400:kworker.0 Request processed in 53us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830067.555200:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787830067.555220:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787830067.555228:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284159488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830067.555267:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1874675284159488:12345-0@lo:400:kworker.0 Request processed in 41us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830067.555273:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787830067.555291:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284159872 00000100:00100000:1.0:1787830067.555302:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284159872 00000100:00100000:1.0:1787830067.555325:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284159744 00000100:00100000:1.0:1787830067.555328:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284159744 00000100:00100000:1.0:1787830067.555340:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284159616 00000100:00100000:1.0:1787830067.555342:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284159616 00000100:00100000:1.0:1787830067.555355:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787830067.555362:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874675284159872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830067.555398:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874675284159872:12345-0@lo:400:kworker.0 Request processed in 36us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830067.555404:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787830067.555415:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787830067.555421:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874675284159744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830067.555447:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874675284159744:12345-0@lo:400:kworker.0 Request processed in 27us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830067.555453:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787830067.555464:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787830067.555469:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9a424f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284159616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830067.555496:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9a424f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1874675284159616:12345-0@lo:400:kworker.0 Request processed in 27us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830067.555501:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787830067.555519:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284159232 00000100:00100000:1.0:1787830067.555523:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284159232 00000100:00100000:1.0:1787830067.555547:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787830067.555553:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b6f5fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:3281:x1874675284159232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830067.555584:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b6f5fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:defee3f2-32c0-45d9-9a5f-ef73e4ad629c+19:3281:x1874675284159232:12345-0@lo:400:kworker.0 Request processed in 31us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830067.555590:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:1.0:1787830067.555633:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787830067.555639:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787830067.555673:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1874675284159616:0@lo:400:kworker.0 00000100:00100000:1.0:1787830067.555683:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1787830067.555688:0:3278:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e9b5955e940, transno 8589934595 00000004:00080000:1.0:1787830067.555698:0:3278:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1787830067.555718:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1874675284159488:0@lo:400:kworker.0 00000100:00100000:1.0:1787830067.556940:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:defee3f2-32c0-45d9-9a5f-ef73e4ad629c:3281:1874675284159232:0@lo:400:kworker.0 00000100:00100000:1.0:1787830067.557890:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1874675284159744:0@lo:400:kworker.0 00000100:00100000:1.0:1787830067.557914:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1874675284159360:0@lo:400:kworker.0 00000100:00100000:1.0:1787830067.557928:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9a424f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1874675284159872:0@lo:400:kworker.0 00000100:00100000:0.0:1787830067.558235:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787830067.558250:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b5955e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284160000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787830067.558313:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830067.558357:0:15018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675284160000 00000100:00100000:0.0:1787830067.558362:0:15018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675284160000 00000100:00100000:0.0:1787830067.558405:0:15018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787830067.558414:0:15018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b7f3cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284160000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787830067.558447:0:15018:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1787830067.558491:0:15018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b7f3cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1874675284160000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830067.558498:0:15018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787830067.558538:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b5955e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1874675284160000:0@lo:13:osp-pre-1-0.0 Debug log: 29629 lines, 29629 kept, 0 dropped, 0 bad.